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I 

Abstract 

We consider products of independent random matrices with independent entries. 
The limit distribution of the expected empirical distribution of eigenvalues of such 
products is computed. Let x\'f} , 1 < j, r < n, = 1, . . . , to be mutually independent 

complex random variables with E Arj^-* = OandE|Aj^-'| = 1. Let X'"' denote annxn 

matrix with entries [X^'^^jjfc — --^Arjj^\ for 1 < j,k < n. Denote by Ai,...,A„ the 

eigenvalues of the random matrix W := n"Li ^^i^ define its empirical spectral 
distribution by 

1 " 

Tn{x,y) - V'llReAfc < x,lmXk < y}, 
n ^-^ 

k=l 

where I{B} denotes the indicator of an event B. We prove that the expected spectral 
distribution F^\x,y) = E J^^'"' (a;, y) converges to the distribution function G{x,y) 
corresponding to the m-th power of the uniform distribution on the unit disc in the 
plane R^. 



1 Introduction 

Let m > 1 be a fixed integer. For any n > 1 consider mutually independent identically 
distributed (i.i.d.) complex random variables 1 < i, ^ < v = l,...,m with 

EX]^^ = and E|X]^^| = 1 defined on a common probability space (i7„,F„,Pr). Let 

^Partially supported by RF grant of the leading scientific schools NSh-638. 2008.1. Partially supported 
by RFBR, grant N 09-01-12180 and RFBR-DFG, grant N 09-01-91331. Partially supported by CRC 701 
"Spectral Structures and Topological Methods in Mathematics", Bielefeld 
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X^*^^ denote an n x n matrix with entries [X^''-*]jfc = -^xj^ , for 1 < j, A; < n. Denote by 

Ai, . . . , A„ the eigenvalues of the random matrix W := HiILi ^^'^^ and define its empirical 
spectral distribution function by 

1 " 

J^n{x,y) = - V]l{ReAfc < x,ImAfc < y}, 

k=l 

where I{B} denotes the indicator of an event B. We shall investigate the convergence 
of the expected spectral distribution Fn{x,y) = EJ^nix,y) to the distribution function 
G{x, y) corresponding to the m-th power of uniform distribution on the unit disc in the 
plane with Lebesgue-density 

9{x, y) = — Tv^— T^^i^' + y^^ 

We consider the Kolmogorov distance between the distributions Fn{x,y) and G{x,y) 

An := sup \Fnix,y) - G{x,y)\. 

The main result of this paper is the following 

Theorem 1.1. LefEX^l^ = 0, E = 1. Then, for any fixed m>l, 

lim sup \Fnix, y) - G{x,y)\ =0. 

The result holds in the non-i.i.d. case too. 

Theorem 1.2. LetEX^^l^ = 0, E = 1 and assume that the random variables X^^^ 

have uniformly integrable second moments, i. e. 

maxE\xll^\^I{\xll^\> M} ^0 as M ^ oo. (1.1) 

u,j,k ■' 

Then for any fixed m > 1, 

lim sup|F„(x,y) - G{x,y)\ = 0. 

n^oo x,y 

Definition 1.3. Let /-fn(-) denote the empirical spectral measure of an n x n random 
matrix X and let /i(-) denote the uniform distribution on the unit disc in the complex 
plane C. We say that the circular law holds for random matrices X if E/i„(-) converges 
weakly to the measure /i(-) in the complex plane C. 

Remark 1.4. For m = 1 we recover the well-known circular law for random matrices [9], 

m- 

Theorems II . II and 1 1 . 2 1 describe the asymptotics of the spectral distribution of a product 
of m independent random matrices. This generalizes the result of [9] and |15j . 
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1.1 Discussion of results 

The proof of these results are based on the author's investigations on asymptotics of the 
singular spectrum of product and powers of random matrices with independent entries 
(see [T], [2], [3]). Our results give a full description of the complex spectral distribution 
of products of large random matrices. The results mentioned on the asymptotic distribu- 
tion of the singular spectrum of products of independent random matrices where already 
obtained some time ago by the authors, see [2]; [I]- Related previous results concerned 
bounds for the expectation of the operator norm of two independent matrices, see Bai 
(1986). [5]- In Bai (2007), [1], the asymptotic distribution of the product of a sample co- 
variance matrix and an independent Wigner matrix is investigated. Some questions about 
the asymptotic distribution of products and powers of random matrices were studied in 
Free Probability. For example, in Capitaine (2008), [7], the asymptotic distribution of the 
singular value distribution of the product of squares of independent Gaussian random ma- 
trices is determined. In Speicher (2008), [H], the same asymptotic distribution has been 
obtained for the singular value distribution of products and powers of random matrices. 

A related result for norms has been obtained by Haagerup and Torbj0nson |10] . who 
proved that if X^^^ , • • • , X^™^ is a system of independent Gaussian random matrices and 
corresponding semi-circular system in a C* probability space, then for every 
polynomial p in r non commuting variables we have an asymptotic norm equality 



which holds almost surely. 

Our result on the asymptotic distribution of the complex eigenvalues of products of 
large (non-Hermitian and non Gaussian) random matrices seemed to be new. After finish- 
ing this paper we learned though that the case of products of Gaussian had been studied 
by Burda et al. (2010), j6], with our main result stated as conjecture, supported by 
simulations. 

We expect that results of this type will be useful for the analysis of some models of 
wireless communication. See for instance, [llj . 

The results of both Theorems 11.11 and 11.21 may be considered as generalizations of the 
circular law, see e.g. [9] for some history on the circular law and its proof. 

To prove the claim of both Theorems 11.11 and 11.21 we use the logarithmic potential 
approach as in [9]. We may divide this approach into two parts. The first part deals with 
the investigation of the asymptotic distribution of the singular values of shifted matrices 
W(z) := W — zl. To study these distributions we use the method developed in [3] for the 
case z = 0. The other part will be the investigation of small singular values of matrices 
W(z) for any z € C This problem may be divided again in two parts. The first part 
consists of the investigation of small singular values. Here we may use our results in [9] 
or the results in |15j . The second part deals with the investigation of the singular values 
between the smallest one to the jth smallest one, where j > n — rf for some < 7 < 1. 
Here we use a modification of techniques of Tao and Vu in [H] . 




(1.2) 
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In the remaining parts of the paper we give the proof of Theorem 11.21 Theorem 11.11 
follows immediately from 11.21 We shall use the logarithmic potential method which is 
outlined in detail in [9]. 

In Section [3] we derive the approximation of the singular measure of the shifted matrix 
W(2;) for any z £ C This allows us to prove the convergence of the empirical spectral 
measure of the matrix W(z) to the corresponding limit measure in M^. The convergence 
is proved in Section [H 

In the what follows we shall denote by C and c or 6, p, rj (without indices) some general 
absolute constant which may be change from one line to next one. To specify a constant 
we shall use subindices. By I{A} we shall denote the indicator of an event A. For any 
matrix G we denote the Frobenius norm by ||G||2 and we denote by ||G|| its operator 
norm. 

Acknowledgment. The authors would like to thank Sergey Bobkov for helpful dis- 
cussions concerning Maurey's result and Gemot Akemann for drawing our attention to 
the paper [6]. 

2 Auxiliary Results 

In this Section we describe a symmetrization of one-sided distribution and a special repre- 
sentation of symmetrized distributions of squares singular values of random matrices and 
prove some lemmas about a truncation of entries of random matrices. 

2.1 Symmetrization 

We shall use the following "symmetrization" of one-sided distributions. Let be a positive 
random variable with distribution function F{x). Define ■= £^ where e is a Rademacher 
random variable with Prj^e = ±1} = 1/2 which is independent of S,. Let F{x) denote the 
distribution function of It satisfies the equation 



We apply this symmetrization to the distribution of the squared singular values of the 
matrix W(z). Introduce the following matrices 



Here and in the what follows A* denotes the adjoined (transposed and complex conjugate) 
matrix A and O denotes the matrix with zero-entries. Consider matrix 



Note that V(z) is a Hermitian matrix. The eigenvalues of the matrix V(z) are — si, . . . , —Sn, Sn, ■ ■ ■ ,si. 
Note that the symmetrization of the distribution function Tn{x,z) is a function Tn{x,z) 



F{x) = 1/2(1 + sign{x} F{x^)) 



(2.1) 




J:=J(1). 



Viz) := VJ- J(z). 



(2.2) 
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is the empirical distribution function of the non-zero eigenvalues of the matrix V(2;). By 
(I2.ip . we have 

An = SUp\Fn{x,z) - G{x,z)\, 

X 

where Fn{x,z) = EJ>j(x,z) and G{x,z) denotes the symmetrization of the distribution 
function G^"''^{x,z). 

2.2 Truncation 



we shall assume that the random variables Xj'^ satisfy the following Lindeberg condition: 



We shall now modify the random matrix X*-^) by truncation of its entries. In this section 
we shall assun 
for any r > 

1 " 

L„(r) = max ^ y E \X^l^\'^I{\x'^l^\ > r^^} ^0, as n^oo. (2.3) 

l<u<m n ^ — ' -' 

It is straightforward to check that this Lindeberg condition follows from uniform integra- 
bility. We introduce the random variables X^'^,^^^ = X^X} I r,^Av), ^ with Tn — >■ and 

the matrices X^'^''^) = -^(x]^'"^) and W^^) := IlILi^^'''"^- Denote by ^ > . . . > s'h^ 

( ) ( ) f O \ 

the singular values of the random matrix W^'^'' — zl. Let V^'^'' := _ t \* ] ■ 

\ O W'^'^'' / 

We define the empirical distribution of the matrix V'^'^^z) = V'^'^^J — 3{z) by Fn\x) = 
Wi Sfc=i ^{^k^ - ^}+^ Z]fc=i ^ Let s„(q, z) and Sn\a, z) denote the Stieltjes 

transforms of the distribution functions Fn{x) and Fn\x) = Y!iFn\x) respectively. De- 
fine the resolvent matrices R = {y{z) — q1)~^ and R^'^-* = {y^^\z) — where I 
denotes the identity matrix of corresponding dimension. Note that 

s„(a,z) = — ETrR, and s^'^Vq, z) = — ETrR^'^). 
2n 2n 

Applying the resolvent equality 

(A + B - al)-^ = (A - al)-^ - (A - aI)-'^B{A + B - aI)-\ (2.4) 

we get 

\sn{a,z)-sl^\a,z)\ < ^E |TrRW(V(z) - vW(z))JR|. (2.5) 

2n 

Let 

XH O \ „iu,c)_( XC'^.^) O 

^ - 1^ O and ' ^ - ^ ^i.m-u+i,cy 

Introduce the matrices 

q=a q=a 
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We have 



V(z) - V('=)(z) = [V- v(^)]j 



m—1 



q=l 



(2.6) 



Applying max{||R||, ||R(^)||} < v ^, inequality (|2.5p . and the representations (|2.6p to- 
gether, we get 



^ m 

|.(r)(z)-.W(z)|<^j;Ei||(X(^+i) 



X(^+i'^))||i4E^I|vS:J_iRR(^)v,+i,^||i. 

(2.7) 



n 



By multiplicative inequalities for the matrix norm, we get 



|2 

,m. II2 



Applying the result of Lemma 17.21 we obtain 



E||vg_iRR('=)V,+i,„||i<^. 



Cn 



Direct calculations show that 



1 r " 

Ie ||X<.) - X<-)||^ < ^ E E |X,'?P/,„<.,,^„,^, < CL„(r, 



j,k = l 



Inequalities (H^D, ([IS]) and[2J]) together imply 

\Snia,z) - sl^\a,z)\ < '^V-^ri(Tn) ^ 
(c) 

Furthermore, by definition of X^^: , we have 



1 



This implies that 



Ex(-)iiB^EEiE^]rp< 



('?.c)|2 ^ CLn{Tn) 



j=l k=l 

Corresponding to H^'^''^^ introduce H^*^'^) 



(2.8) 



(2.9) 



(2.10) 



(2.11) 



O 



O (X(^''=) - EX^'^''^))*;' 

and for the matrices W^'^) , V'^'^^ , V^*^^ define matrices W^'^) , V^*^) , V^'^^ respectively. Denote 



by J'n'^ {x) the empirical distribution of the squared singular values of the matrix V^'^^ ( 



z :-- 
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V^'^^J — J{z). Let s^\a, z) denote the Stieltjes transform of the distribution function 

f°° 1 ~ 



X — a 



Similar to inequality (I2.7P we get 

1 



|.(f)(a,z) -5<f)(a,z)| < -^||EX(«'^)||2-^Ei||v(2R(^)R(^)v;5, 
Similar to inequality ()2.8p . we get 



||2 

g=0 



By inequality ([2TT]) . 



||EX(''''^)||2 < 

The last two inequalities together imply that 



CT„. 



\s(:Ha,z)-^Ha,z)\ < £^3^ < ^ (2.12) 

Inequalities (j2.10p and (j2.12p together imply that the matrices W and W^*^) have the same 
limit distribution. In the what follows we may assume without loss of generality for any 
= 1, . . . , m and j = 1, . . . n, /c = 1, . . . , n and any / = 1, . . . , m, that 

Exj^) = 0, ^Xff = 1, and \xf^\ < cr^^ (2.13) 

with 



Ln{Tn)/Tl < Tn- 



3 The Limit Distribution of Singular Values of the Matrices 

Y{z) 

Recall that = (y y^{r2u+i*) and J(z) := ^^^^ , J := J(l). For any 

I < u < fi < m, put 



and 

V{z) := YJ -3{z). 
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We introduce the following functions 

Sn{a, z) = - ^ E [R(a, z)]jj = - X] ^ Ma, z)]j+nj+n = 7^^.^ t^^"' 
j=l j=l j=l 

-j^ n 1 " 

tn(a,z) = -^E[R(a,z)]j+nj, nn(a, z) = - ^ E [R(q;, (3.1) 
^ i=i " j=i 

Theorem 3.1. // the random variables X^^^ satisfy the Lindeberg condition i2.3\) . the 
following limits exist 

y = y{z,a)= lim Sn{a,z), t = t{z,a)= lim tn{a,z), 
and satisfy the equations 

l + wy+ (-l)™+l«;'"-ly'^+l = 0, 

y{w — a)^ + {w — a) — y\z\'^ = 0, 

w = a + —. (3.2) 

y 

Remark 3.2. Since the Lindeberg condition holds for i.i.d. random variables and for 
uniformly integrable random variables the conclusion of Theorem 13.11 holds by Theorem 
Oand Theorem O 

Proof. In the what follows we shall denote by e„(a, z) a generic error function such that 
\enia,z)\ < for some positive constants C,p,r. By the resolvent equality, we may 
write 

1 + asn(a, z) = — E Tr V(z)R(a, z) = — E Tr VJR(a, z) — ztn(a, z) — zUn(o:, z). (3.3) 
2n 2n 

In the following we shall write R instead of R(a, z). Introduce the notation 

^:=— ETrVJR (3.4) 
2n 

and represent A as follows 

A=]^Ai + ^A2, (3.5) 

where 

Ai = -Y,^ [VJR]jj , A2 = -J2^ [VJR],+„j+„. 

By definition of the matrix V, we have 

1 " 

= n ^ EX];)[V[2HJR]fci- (3-6) 
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Note that 

9V[2,„] JR _ ^ 

- V[2,m] Jl^ej-efc V[2^m] JR - V[2^m] JRV[i^„_i]efc+„eJ_|.„JR. (3.7) 
Applying now the Lemmas 17.81 we obtain 

^ n 1 ^ 

Ai = E [V[2,m] JR^[l,m-l]]fcfc+n— E [JRjj+nj + gn(^^, «)■ (3.8) 

fc=l " j=l 

Introduce the notation, for i' = 2, . . . ,m 

1 

/i^ = - X] E [V[,^^,„] JRV[i_,,„_,,_^i]]jj+„ (3.9) 
" i=i 

We rewrite the equahty ()3.8p using these notations 

■Ai = -f2Sn{a,z) + en{z,a). (3.10) 
We shall investigate the asymptotics of fy for i' = 2, . . . ,m. By definition of the matrix 

V 

[u.m] ! ^6 have 

1 " 

JKV[i^„_j,_,_i]]fcj+„ (3.11) 

fcj=l 

For simplicity assume that u <m — v. Then 

T 

~ "^[iz+l/m] JI^V[l,m-!/]6fe+r!.eJ+„V[,„_^_,_2,m] JKV[l,m-j/+l] (3.12) 

Applying the Lemmas 17.81 again, we get 
1 " 

= - ^ E [V[j,+i JRV[i „,_j,]]fcfc+„ 
fc=i 

^ n 1 " 
E E [V[^^i^„] JRV[i^„^_j,]]fcfc+„— ^ E [V[„„,^+2,m] JR-Vji^m.j^+ijJj+nj+n 

k=i i=i 
1 " 

= fv+l{^ X!/"^ [V[m.-i/+2,m] JR^[i^„_j,_^l]]j+„j+„) (3.13) 
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Note that 

— ^ E [V[m-u+2,m]-^'^^[l,m-u+l]\j+nj+n = — ^ E [V[i^,„] JR] (3-14) 



Furthermore, 

1 " 

- [V[i_„]JR]j+„j+„ = l + asnia,z) + zun{a,z). (3.15) 

Relations (|3.12p - (j3.15p together imply 

fu = fu+ii-OiSn{a, z) - zun{a, z)) + en{z, a). (3.16) 

By induction we get 

/2 = {-ir~\asn{a,z) + zun{a,z)y"'-hn{a,z)+en{z,a). (3.17) 
Relations (j3.10p and (13.17P together imply 

Ai = (-l)™(as„(a, z) + zun{a, z))'^~'^ sl{z , a) + en{z, a). (3.18) 
Similar we get that 

92 = i-ir~HaSn{a, z) + zt„(a, z))"^"^ Sn{oi, z) + e„(z, a). (3.19) 

and 

A2 = (-l)'"(as„(a, z) + ztn{a, z))™-!^ (z, a) + e„(z, a). (3.20) 
Consider now the function tn(ct) z) which we may represent as follows 

1 

atn{a, z) = - ^ E [V(z)R],+„,-. (3.21) 

By definition of the matrix H'^"'^-' , we may write 

1 " 

atn{a, z) = -Y, ^^jk^^M^^h+nk - z Sn(a, z). (3.22) 

^ j,k=l 

For the derivatives of the matrix Vj2,m]JR- by we get 

9V[2,m]JR y 
:(;^ = V[2,,„_i]ejefcJR 



V[2,m] JR-efc+„eJ+„V[2_m] JR - V^,™] JRV[i^„_i]eje^JR. (3.23) 
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Relation p.23p and Lemmas (|7.8p together imply 

^ n 1 " 

atn{a,z) = -- [V^2,mlJRV[i,m-i]]j+nj- [Rjfc+nfc -zSn{a,z) +en{z,a) 

j=l k=l 
= §2 tn{a, z) -z Sn{a, z) + en{z, a). (3.24) 

Applying equality (13.19p . we obtain 

atnia,z) = {-l)'^{asn{a, z)+zun{a, z))''^~'^Sn(a, z)tn{a, z)-z Sn{a, z)+eniz,a). (3.25) 

Analogously we obtain 

au„(a, z) = (-l)'"'(as.„(a, z)+ztn{a, z))"^~'^Sn{o:, z)un{a, z)-z s„(a, z)+en{z, a). (3.26) 

Multiplying equation (|3.25p by z and equation (j3.26p by z and subtracting the second one 
from the first equation, we may conclude 

ztn{a, z) = zun{a, z) + e„(z, a). (3.27) 

The last relation implies that 

Ai=A2 + en{z,a). (3.28) 
Relations (fOD . IXTHD . (Km . (Km and ([3:28]) together imply 

1 + a s„(a, z) = (-l)'"(as„(a, z) + z t„(a, z))"^~^ sl^{z, a) - z tn{a, z) + en{z, a). (3.29) 

Introduce the notations 

t \ I ^n(Q^) -2) /„ „„x 

Vn := Sn{a,z), tt;„:=aH . (3.30) 

Vn 

Using these notations we may rewrite the equations (j3.29p and p.27p as follows 

1 + WnVn = (-l)™C+'<"' + ^n{z, a) 

{Wn -a) + {Wn - afVn " ^nkP = £n{z, o). (3.31) 

Let n,n' — )• oo. Consider the difference y„, — From the first inequality it follows that 
I _ ^ \en,n'{z,a)\ + \wn - Wn'Wvn + {-ir^'yT\<~' + " " " + .3 

" \wn + {-ir+^yT\wn + {-i)^+^w^~\y^ + --- + y':,)\ 

Note that max{|y„|, |yn'|} — ^ ^'^'^ niax{|t(;„|, |tt;„'|} < C + v for some positive constant 
C = C{m) depending of m. We may choose a sufficiently large vq such that for any v '>vq 
we obtain 

|e„,„/(z,a)| C 

yn - yn' < \ \Wn- Wn'\- (3.33) 

V V 
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Furthermore, the second equation imphes that 

{Wn - Wn')il + yn{Wn + Wn' " 2a)) = [Vn - yn'){{Wn " af - |zp) +e„,„'(z,a). (3.34) 

It is straightforward to check that max{|t(;„ — a|, \wni — a|} < (1 + |en(-2j ci)|)|z|. This 
imphes that there exists vi such that for any v >vi 

\wn -Wni\ < \en,n'{z,a)\ + 4\zf\yn - y'J. (3.35) 

Inequahties (j3.33p and (|3.35p together imply that there exists a constant Vq such that for 
any v >Vo 

lyn-y'nl <\^n,n'{o:,z)\, (3.36) 

where e„.„'(a,z) — )• as n — )• oo uniformly with respect to > Vq and \u\ < C {a = 
u + iv). Since yn-,yn' are locally bounded analytic functions in the upper half-plane we 
may conclude by Montel's Theorem (see, for instance, [8], p. 153, Theorem 2.9) that there 
exists an analytic function yo in the upper half-plane such that limyn = yo- Since yn are 
Nevanlinna functions, (that is analytic functions mapping the upper half-plane into itself) 
yQ will be a Nevanlinna function too and there exists some distribution function F[x^ z) 
such that yo = X!^ ■^dF{x, z) and 

A„(z) := sup |F„(a;, z) — F(x, z)| — > as n — oo. (3.37) 

X 

The function y^ satisfies the equations (|3.2|) . 
Thus Theorem 13.11 is proved. 

□ 

4 Properties of Limit Measures 

In this section we study the measure -F(x, z) with Stieltjes transform s{a, z) = jr^ll^ F'ix, z) 
satisfying the equations 

l+wy + (-l)'^+l«;'"-ly'"+l = 0, 

y{w - af + {w - a) - y\z\^ = Q. (4.1) 

Consider the first equation in ()4.ip with w = u = \/—lv. Assume that there are two 
solutions of these equation, say yi and y2, which are Stieltjes transform of some measures. 
Then we have 

(yi - y2)w + {-ir+'w"'-Hyi - y2)(y'" + • • • + yT) = o. (4.2) 

Note that 

Im{(-l)'"+^w;""-iy™} > 0, j = 1,2. (4.3) 
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Indeed, by equation (|4.ip 



Im{(-l)"*+^u;"^-iyy^} = -v>v — > 0. (4.4) 



Note that if Im^™ > for j = 1,2 then Im {^J''^^"''} > for every k = 0,...,m. This 
imphes that 

Im{(-l)'^+iu;'"-iyfy™"'=} > 0. (4.5) 

From here it follows that 

\w + i-ir+^w'^-^y"' + ■■■ + yT)\ >v>0 (4.6) 

and 

2/1 = 2/2- (4.7) 

It is well-known that the Stieltjes transform of a distribution function F{x) with moments 
given by the Fuss-Catalan numbers FC{m,p) = ^p_)_p (^^^^) satisfies the equation (|4.ip 
(see, for instance, [T]). This distribution has bounded support given by < Cm '■= 

(m+l)'"+i 



The second equation has a solution 



-1 + ^1 + 47/2^2 

w;-a = , (4.8 

with Im{t(; — q} > and — a| < 

Corollary 4.1. Letp{x,z) denote the density of the measure v{x,z) with Stieltjes trans- 
form s{a,z). Then, for any \z\ and \x\ > Cm + \z\, we have 

p{x,z)=Q (4.9) 

Otherwise p{x, z) > holds. For z = we have 

m— 1 

p{x,z) = 0{\x\ '"+i) as x^O. (4.10) 

It is straightforward to check that the logarithmic potential of the measure /x^"^^ (the 
m-th power of the uniform distribution on the unit circle) satisfies 

I — log Izl, Izl > 1 , , 

^M(™)(^) = Un \ \~,- (4-11) 

^ I y(l - \z\m), \z\ < 1 



Corollary 4.2. For x = we have 

( 

s(0,z) = 



0, \z\ > 1 

(4.12) 



j \/l-\z\^ 



Z < 1 
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We investigate now the connection of family of measures with the distribution 

of where (" is uniformly distributed on the unit disc in the complex plane. We prove 
the following Lemma. 



Lemma 4.3. For z = u + iv we have 

ds{x,z) s{x,z) ds{x,z) 



du y/l + 4|z|2s2(x,z) dx 
Proof. Let y = s{x,z). Denote by Ri{y,w,z), i = 1,2 the functions 

R,: = R,{y,W,Z,x) - 1 + + 

i?2 := R2{y, w, z, x) := (w - x)'^y + {w - x) - \z\^y. 
Differentiating both functions with respect to x and by u, we get 

dy —"^yu 

^ ^ dRi dR2 dR2 dRi 
dw dy dw dy 



It follows immediately that 



dy —2{w — x)y — 1 

^ dRx dR2 dR2 dRi ' 
dw dy dw dy 



dy —'^uy dy 



du —2{w — x)y — Idx 
Taking in account the equality (|4.8p . we get 



(4.13) 



(4.14) 



(4.15) 



dy „ y dy 

-77- = — =— — , (4. lb) 

du ^l + 4|z|2y2 dx' ^ ' 

which completes the proof. □ 
Introduce now the function 

/oo 
log |x|(iz^(2:, x). 
-00 

Lemma 4.4. The following relation holds 

V{z)=U^,r.,{z). 

Proof. We start from the simple equality, for z = u + if , 

dU^(,n){z) _ j kl > 1 

du I " 7T1-1 ; < 1 

We prove that 

dVjz) ^ dU^jz) 
du du 
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Let A{x) = —\/—ls{z, \/—lx), where x > 0. The symmetry of function z^(z, y) in y imphes 
that the function A(a;) will be real and non-negative. We have 



By Corollary 14.21 we have 



1^1 

Note that lim^^-^oo A(x) = 0. We consider integral 

fC 



B{C,z) = [ A{x)dx. 
Jo 

Using the representation ()4.17p . we get 

B{C,z) = - log\y\p{y,z)dy + - log{l + ■^)p{y, z)dy + log C. (4.19) 
We rewrite this equality as follows 

V{z) = B{C, ^) + ^ /" log(l + ^)piy, z)dy + log C, (4.20) 



which implies 

du 

According to Lemma 14.31 we get 

aA(x) 2^iA(2;) aA(x) 



^VW = -B(C,.) + -- y_ Jog(l + y,(y,.),y^ (4.21) 



(4.22) 



9m v^1-4|z|2A2(x) 9x ' 

Note that the quantity A(x) satisfies < A(x) < ^jTy • There exists a point xq such that 
A(xo) = Thus we get 

^ A{x)dx= ^A{x)dx = 2u ^ ' =^A{x)dx (4.23) 

duJo ^ ' Jo du ^ Jo ^l-4|z|2A2(x) dx ^ ' ^ ' 



2|z|2 



A(o) Ja{C) J a/1 - 4a2|z|2 

1 - 4|z|2A2(C) + x/l - 4|z|2A2(0)) (4.24) 
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Simple calculations show that in the limit C — t- oo, we obtain 

lim — 5(C,z) = lim — / ^{x)dx={ , ^ . (4.25) 

C^oo Bu ^ ' C^oo Bu Jq ^ ' I if |z| > 1 ^ ' 

\ \A >" 

Consider now the quantity 

rj /'OO 2 

^(C^) = ^ y log{l + ^My,z)dy. 
By Corollary 12.71 we have 

A{C) = —J log (^1 + ^2 J (4.26) 



-2:3 

Using equality p{y,z) = Ims(z,y), we may rewrite equality (|4.26p as follows 

rCo 
-Co 



A{C) = Im jy J log (^1 + ^s{z,y)dy^ . (4.27) 
Applying Lemma 14.31 we get 

MO = to I log (l + ^'fa-->0 . (4.28) 

2 2 

Integrating by parts and using the inequality | log(l + ^)| < with some constant 
7 > 0, and |s(2Co,-<;)| < and |s(0, z)| < we conclude that 

lim A{C) = 0. (4.29) 

C^oo 

Collecting the relations (I4.2ip , ()4.25p , and (I4.29P concludes the proof of the Lemma. □ 

5 The Minimal Singular Value of the Matrix W — zl 

Recall that 

m 

w = JJx^'^), 

where X^^^ , . . . , X^™") are independent nx n matrices with independent entries. Let 
W(z) = W — zl and let s„(A) denote the minimal singular value of a matrix A. Note 
that 

s„(A) = inf IIAxlh. 

x:||x|| = l 
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Introduce the matrix W(i) = 0^=2 ^'■''^ ■ We may write 
s„(W(z)) = inf ||W(z)x||2 > inf ||(x(^) - z(w(i))-^)x||2 inf HW^^^xHs. (5.1) 

x:|jx|| = l x;||x|| = l x:||x|| = l 

By induction, we obtain 

m 

Sn{yV{z)) > 5„(X(1) - Z(W^'Y')) n (5-2) 

Lemma 5.1. Let X^^^} be independent complex random variables with 'EiXjk = and 
E|Xjfcp = 1, which are uniformly integrable , i.e. 

maxE|x]^^|2/||^^.^l>^^^0 as M ^ oo. (5.3) 

Let K > 1. Then there exist constants c,C,B > depending on 9 and K such that for 
any z G C and positive £ we have 



Pr{s„ < e/n^; max si(x('')) < Kn} < exp{-c n} H , (5.4) 

l<u<m Jn 



where Sn = s„(W(z)). 

Proof. The proof is similar to the proof of Theorem 4.1 in [9]. Applying inequality (j5.2p . 
we get 

P^{sn < e/n^; max si(X('')) < Kn} 

l<i/<m 

< Pr{s„(X(i) - z(W(i))"i) < £^n^^; max SiiX.^"^) < Kn} 

l<u<m 

m 

+ VPr{s„(X('')) < e^n-i; max siiX.^"^) < Kn}. (5.5) 



l<u<m 

v=2 



Furthermore, 



Pr{s„(X(i) - z(W(i))~i) < e-n"™; max si(X('')) < Kn} 

l<u<m 



< Pr{s„(xW - z(wW)-i) < s^(xH) < Kn; si(wW ^) < 7i^} 

+ Pr{si(w(^)"^) > n^; max si(X('')) < Kn}. 



l<i/<m 

(5.6) 



Note that 

m m 

si(w«"') < n ^iix^'')"') = n ^uH^^"^)- (5.7) 



!^=2 u=2 
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Applying this inequality and Theorem 4.1 in [9], we obtain 



Pr{si(wW ^)>n^; max si(x('^)) < Kn} < exp{-c n} + '^^^ 



(5-8) 



with some positive constants C, c > 0. Moreover, adapting the proof of Theorem 4.1 in 
[H], we see that this theorem holds for all matrices X^^^ — zB uniformly for all non-random 
matrices B such that ||B||2 < Cn^ for some positive constant Q > 0, i.e. 

Pr{s„(X(i) - zB) < en-^, si(X(i)) < Kn} < exp{-c n} + (5.9) 



with a constant depending on C and Q and not depending on the matrix B. Since the 
matrices X^^^ and W'^^-' are independent, we may apply this result and get 



Pr{s„(x(^)-zW(^) ^ < en-^, sifX^^h < Kn; sUW^^^ ^ < Cn^} < exp{-c n}+^^^ 

(5.10) 

Collecting the inequalities (|5.5p - (|5.10p . we conclude the proof of the Lemma. 

□ 



Following Tao and Vu [15] , we may prove sharper results about the behavior of small 
singular values of a matrix product. 

We shall use the following well-known fact. Let A and B be n x n denote matrices 
and let si(A) > • • • > Sn(A) resp. (si(B) > • • • > Sn(B) and si(AB) > • • • > Sn(AB)) 
denote the singular value of a matrix A (and the matrices B and AB respectively). Then 
for any 1 < A; < n we have 

n n 

lls,{AB)>l[sj{A)s,{B), (5.11) 

j=k j=k 

and 

n n 

J{sj{AB) = \{s,{A)s,{B) (5.12) 
i=i 3=1 
(see, for instance [12], p. 171, Theorem 3.3.4). 

We need to prove a bound similar to the bound (45) in |15| . namely: 

^ n—n^ 

lim - V lns,(W - zl) = 0, (5.13) 

j=n-n5n 

for any sequence 5n — )• 0. To prove this bound it is enough to prove that for any v = 
1, . . . ,m and any fixed sequence of matrices M„ with ||M„,||2 < Cn^ for some positive 
constant B > 

^ n—n'' 

lim- y lns,(X('') +M„) =0. (5.14) 

n— s>oo n ^ — ' 

j=n-n5n 
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Indeed, it follows from (|5.1ip . that 

m—l n—n^ 



^ I li I li ^ I I L J.((. I 1/ ^ I 1/ (t 

- InSj(W-zI) > - ^ lnSi(X('^^) + - lnSj(X("^)+M„), (5.15) 



j=n— no„ i/=i j=n— no„ j=n—nd„ 



where M""*^ = Oil^i^ -^^"^^ ■ Note that the matrices X^"^'^ and M„ are independent and 
it follows from our results in [S], Lemma Al, that ||M„||2 < Cn^ for some B > with 
probability close to one. The relations 

^ n— 

lim — In SofX^*^^) = 0, for v = l,...,m — l, 

n— 5>oo n ^ — ' 

j=n—n5„ 

^ n—nT' 

lim- y lns,(X("^) +M„) =0 (5.16) 

n— >co n ^ — ' 



j=n~nO' 



follow from the bound 



SjiX^"^ + Mn) > c\/^^^-^, 1 < j < n - n^. (5.17) 



To prove this we need the following simple Lemma. 

Lemma 5.2. Let lim,„_j.oo Sn = and let Sj, for n — n5n < j < n — with < 7 < 1 
denote numbers satisfying the inequality 



Sj>c\- — -. (5.18) 
V n 

Then 

lim - V Ins,- = 0. (5.19) 

n— >oo n ^ — ' 

n—nSn^j^Ti—nri 

Proof. Without loss of generality we may assume that < Sj < 1. By the conditions of 
Lemma 15.21 we have 

0>- V Ins. >- V ln{^^} = A (5.20) 
n ^ ^-^ n ^ ^-^ n 

n—nOn<j<:n—n~f n—nOn<j<:n~ni 

After summation and using Stirling's formula, we get 

< (5„| ln(5„| + (1 — 7)n'^~^ Inn — )■ 0, as n — )• 00. (5-21) 
This proves Lemma l5.2[ 

□ 
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It remains to prove inequality (j5.17p . This result was proved by Tao and Vu in [15] 
(see inequality (8.4) in [E]). It represents the crucial result in their proof of the circular 
law assuming a second moment only. For completeness we repeat this proof here. We 
start from the following 

Proposition 5.1. Let 1 < d < n — with ^ < 7 < 1. and < c < 1, and H 6e a 

(deterministic) d- dimensional subspace of C^. Let X be a row of An := X + M„. Then 

Pr{dist(X,]H) < cVn - d} = 0(exp{-ni}), (5.22) 
where dist(X, H) denotes the Euclidean distance between a vector X and a subspace H in 

Proof. It was proved by Tao and Vu in [15] (see Proposition 5.1). Here we sketch their 
proof. As shown in [15] we may reduce the problem to the case that E X = 0. For this it 
is enough to consider vectors X' and v such that X = X' + v and E X' = 0. Instead of 
the subspace H we may consider subspace M' = span(]HI, v) and note that 

dist{X, M) > dist(X', M'). (5.23) 

The claim follows now from a corresponding result for random vectors with mean zero. In 

what follows we assume that EX = 0. We reduce the problem to vectors with bounded 

1—7 

coordinates. Let = I{\Xj\ > n^~}, where Xj denotes the j-th coordinate of a vector 
X. Note that p„ := < n~^^~'^\ Applying Chebyshev's inequality, we get, for any 
h>0 

n 

Pr{^ > 2ni'} < exp{-/in^} exp{np„(e^ - 1 - h)}. (5.24) 
i=i 

Choosing h = j, we obtain 

Pr{j;Ci > 2nT} < exp{-— }. (5.25) 

Let J C {1, . . . ,n} and Ej := {Ylj^j{l - Cj) Hj^j^j = !}• Inequality (|5.25p implies 

Pr{ U i?j}>l-exp{-— }. (5.26) 

J:| J|>n-2nT 

Let J with |J| > n — 2n'^ be fixed. Without loss of generality we may assume that 
J = 1, . . . , n' with some n — 2n'^ < n' < n. It is now suffices to prove that 



Pr{dist(X, M) < cV^^^\Ej} = 0(exp{-— }). (5.27) 

8 

Let vr denote the orthogonal projection vr : C"" — )• C" . We note that 

dist(X,]H) > dist(^(X),7r(]H)). (5.28) 
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Let X be a random variable x conditioned on the event |x| < v} and let X = 
(xi, . . . , Xn). The relation (|5.27p will follow now from 

Pr{dist(X',E[0 < cyf^r^\\xj\ < n^~^,j ^ J} = 0(exp{- — }), (5.29) 

8 

where M' = tt{M) and X' = tt{X). We may represent the vector Xas X = X' + v, where 
u = E X and E X' = 0. We reduce the claim to the bound 



Pr{dist(X',]H") < cV^^^\\xj\ < n^~^,j ^ J} = 0(exp{-^}), (5.30) 

8 

where M" = span(?;, H'). In the what follows we shall omit the symbol ' in the notations. 
To prove (|5.30p we shall apply the following result of Maurey. Let X denote a normed 
space and / denote a convex function on X. Define the functional Q as follows 

Q/(x):=inf[/(y) + ^^]. (5.31) 
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Definition 5.2. We say that a measure satisfies the convex property (r) if for any 
convex function / on X 

/ ex-p{Qf}dfi / exp{-/}d^ < 1. (5.32) 

We reformulate the following result of Maurey (see jl3| , Theorem 3) 

Theorem 5.3. Let (Xj) be a family of normed spaces; for each i, let fii be a probability 
measure with diameter < 1 on Xj, for x G Xj. If fj, is the product of a family (/ij), then fi 
satisfies the convex property (r) . 

As corollary of Theorem 15.31 we get 

Corollary 5.3. Let in be a probability measure with diameter < 1 on X, i = 1, . . . , n. Let 

g denote a convex 1-Lipshitz function on X". Let M{g) denote a median of g. If is the 
product of the family (fii), then 

fi{\g-M{g)\>h}<4exp{-—}. (5.33) 
Applying Corollary 15.31 to /ij , being the distribution of Xj , we get 

Pr ||dist(X,]H) - M(dist(X,]H))| > rnVj < 4exp{-rVl6}. (5.34) 
The last inequality implies that there exists a constant C > such that 

|Edist(X,EI) - M(dist(X,EI))| < CnV, (5.35) 

and 

E dist(X, M) > a/e (dist(X,]H))2 - Cn^ . (5.36) 
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By Lemma 5.3 in |15] 

E(dist(X,H))2 = (l-o(l)(n-(i). (5.37) 

Since n — d > ii? the inequalities (j5.35p . (|5.36p and (j5.37p together imply (|5.22p . Thus 
Proposition 15.11 is proved. □ 

Now we prove (j5.17p . We repeat the proof of Tao and Vu [15], inequality (8.4). Fix j. 
Let A„, = X^*") — 2:M„ and let denote a matrix formed by the first n — k rows of A„ 
with k = j/2. Let a'l, 1 < I < n — k, be singular values of A^ (in decreasing order). By 
the interlacing property and re-normalizing we get 

> (5.38) 



/n 

By Lemma A. 4 in [15 



Note that 



T:=a[ V--- + a;„fc ^ = dist^2^--- + dist-!fc. (5.39) 

T>{j-k)a'-l^ = ^-a'-lj. (5.40) 
Applying Proposition 15.11 we get that with probabiHty 1 — exp{— n'^} 

71 

T<-. (5.41) 
j 

Combining the last inequalities, we get (j5.17p . 

Lemma 5.4. Under the conditions of Theorem \l.l\ there exists a constant C such that for 

1 

any k < n{l - CA^^^z)), 

Pr{sfc < An{z)} < CA^ {z). (5.42) 

Proof. Recall that Fn{x,z) = EJ>i(x,z) denotes the mean of the spectral distribution 
function Tn{x,z) of the matrix H(2;) and that F{x,z) = liuin^oo Fn{x , z) . According 
to Theorem 13. H the Stieltjes transform of the distribution function Fn{x,z) satisfies the 
system of algebraic equations ()3.2p and 

A„(z) = sup |F„(x, z) — F(x, z)| — as n — oo. (5.43) 

X 

We may write, for any k = 1, . . . ,n, 

Pr{sfc < A„(z)} < Pr{J-„(sfc, z) < J-„(A„(z)} < Pr{^^ < j:„(A„(z)}. (5.44) 

n 

Applying Chebyshev's inequality, we obtain 

Pr{., < A„(z)} < a^I^iM^ < n(F(A„(.),.)+A.(.)_ 

n — k n — k 
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It is straightforward to check that from the system of equations ()3.2p it follows 

F(A„(z),z) <CA^(z). (5.46) 
The last inequality concludes the proof of Lemma 15. 4[ 

□ 

Lemma 5.5. Let An{z) := sup^, |F„(x, z) — F{x,z)\. Then there exists some absolute 
positive constant R such that 

Pr{|Afc, \>R}< CVA„(z), (5.47) 

1 

where ki := [A^(z)n]. 

Proof. It is straightforward to check from (jS.Sip that the distribution F(x,z) is com- 

1 

pactly supported. Fix R such that F{R,z) = 1. Let us introduce kQ := [A^n]. Using 
Chebyshev's inequality we obtain, for R > 0, 

PrK„>i?}< ^~ff"^^^ <Ai 
ko/n 

On the other hand, 

fcl ki ^ ki 

Pr{|AfcJ >i2}<Pr{TT|A^| > ii'^i} < PrjTT > ij'^^} < Pr{— V ln4™) >lnR}. 

u=l u=l ^ u=l 

Let k2 = max{l < j < ko : aj > A^^(z)}. If ai < A^^(z) then k2 = 0. Furthermore, for 
any value i?i > 1, splitting into the events Sk^ > R and Sk^ < R, we get 



^ fei 

Pr{— J^lns, > lni?i} < Pr{sfc„ > R} 

+ Pr{-^ J2 lnSj+lnR>^lnRi} + Fi{^f2^nSj>^lnRi} 



u=l 

ko -, , fc2 



ki ^ ' 2 ' 'ki^ ' 2 

j=k2+l j=l 

(5.48) 

Applying Chebyshev's inequality, we get 

fci 

ki 



Pr{- J];ins, > lni?i} < Pr{sfc„ > R} 



+ Pr{^lnA;i(z)>iln|i} + f / \nxdF.^{x, z). 
h 2 R^ ki Ja-\z) 
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Now choose Ri := 2R^. Thus, since ki/ko ~ An{z), and A^(2:)| In A„(2;)| — >• 0, we get for 
sufficiently large n 

Pr{|AfcJ >R}<A^ + — / Inxd Fn{x,z). 
Taking into account that the function decreases in the interval [6~^{z), oc), we get 

■ / ]r\ xrl. F„(x.7.) < 

h Ja-\z) 

(5.49) 

Thus the Lemma is proved. □ 



/ Inxd Fn{x,z) < In A~Hz) x^d Fn{x,z) < Al{z)\nA-\z). 

Ja-^(z) m Jo 



6 Proof of the Main Theorem 

In this Section we give the proof of Theorem 11.11 For any 2; G C and an absolute constant 
c > we introduce the set ^n{z) = {w G : c/n^ < s„(z), si < n, \Xki\ < R — 
An{z)}. According to Lemma 17.41 

Pr{si(X) >n}< CtT^. 

Due to Lemma |5. II with e = c, we have 

Pr{c/n^ > Sn{z)] < + Pr{s-L > n}. 



According to Lemma l5.5( we have 

Pr{|AfcJ < i?} < C\/a;. (6.1) 
Furthermore, in view of Lemma [57 



Pr{sfc < Ar,{z)} < CA;r+' (z). (6.2) 

These inequalities imply 

Pr{J7„(z)^} < CA^(z). (6.3) 

The remaining part of the proof of Theorem 11.11 is similar to the proof of Theorem 1.1 
in the paper of Gotze and Tikhomirov [9]. For completeness we shall repeat it here. Let 
r = r(n) be such that r(n) — )• as n — )■ 00. A more specific choice will be made later. 

(r) 

Consider the potential U/^J . We have 

Uj,'] = -^E log I det(W -zl- rei)| 

= E E log |Af ) - re - - ^ E E log |Af ) - re - z\I^,^^^ 
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where Ia denotes an indicator function of an event A and i^ni^)^ denotes the complement 
of i^niz). 

Lemma 6.1. Assuming the conditions of Theorem \5.1\ for r such that 

1 

ln(l/r) (A*(^)) oo as n 



we have 



-^0, as n oo. 



Proof. By definition, we have 

1 

Applying Cauchy's inequality, we get, for any r > 0, 



(6.4) 



(6.5) 



1 



1 



1 



<(^5:E|log|Af)-re 



|l+r 



Pr{OW} 



(6.6) 



Furthermore, since ^ is uniformly distributed in the unit disc and independent of Aj, we 
may write 



E 



log \Xj — r^^ — z\ 



l+r 1 



-E 



ICI<i 



logjA^."^-* -rC,- z\ 



l+r 



dC = E J^Ve J^-'Ve J;^^^ 



(i) 



where 



r(i) _ 


1 


1 — 


2^ 


rO') _ 


1 


2 — 


2^ 


r(i) _ 


1 


3 ~ 


2^ 



|C|<1, |A('")-rC-2|<e 



loglAj™') -rC-2||^+"dC, 



ICI<1, i>|A(.™'-rC-^|>e 



loglAj'") -rC-zll^+'dC, 



loglA^.""^ -rC-^||'+"dC- 



l+r. 



ICI<1, lAt-'-r-C-.^i 



Note that 



IJ^^'^I < log 



Since for any 6 > 0, the function —vf'Xogu is not decreasing on the interval [0, exp{ — -^j], 
we have for < li < e < exp{— -^j, 



— log u < e^u ^ loe 
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Using this inequality, we obtain, for 6(1 + r) < 2, 
IjPI < flog f i)y^' [ ^ ^ |a(.-) - rC - z\-'('+^Uc (6.7) 



< ^^'^'"-^^-"'log (^) /^kJ^I"'^'^'^'^^ ^ C(r,6)eV-2 (log Q)) \ (6.8) 
If we choose e = r, then we get 



\4'\ <C{T,b) [log ^^jj . (6.9) 

The following bound holds for ^Yl]=i^ ■ ^o^^ ^^^^ |logx|^+^ < e^l log ej^+^x^ for 
X > ^ and sufficiently small e. Using this inequality, we obtain 

- y E jj^') < C{T)e^\ loge|i+n- y E IaS") - < - < C7(t)(1 + + r^)^^! loge|i+- 



1 + T 



n — ' n 



< C(r)(2 + |z|2)r2|logr|^+^|. 

(6.10) 



The inequalities ()6.7p - ()6.10p together imply that 



^^ElloglAj."") -rC-z||^+"| < C (^log(^i^^ . (6.11) 



Furthermore, the inequalities (j6.3p . (|6.5p . ()6.6p . and (j6.1ip together imply 

|C/«|<Clog fi") ((A|(.))ii^. 



We choose r = 1 and rewrite the last inequality as follows 

|f/W|<Clog(i)A|(z) (6.12) 
1 

If we choose r = A„(z) we obtain log(l/r)A^ (2:) — )■ 0, then ()6.4p holds and the Lemma is 
proved. □ 

{^\ 

We shall investigate ?7^^ now. Let f„(--- ^z^r) = E^t'„(-, z + r^) and v{-,z,r) = 
E i^(-, z + rC). We may write 

= -- E E log I Af - z - r^|/^„(,) = -- E E log(^, (X(^)(z, r))/^ 

fKn + \^\ 



logxdEF„(x,z,r), (6.13) 
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where Fn{-,z,r) {F{x,z,r) ) is the distribution function corresponding to the restriction 
of the measure Vn{--,z.,r) (z^(-,z,r)) to the set f^n(-z)- Introduce the notation 

rn+\z\ 

U^ = - log xdF{x,z,r). (6.14) 

Integrating by parts, we get 
^(0 _jj BFUx,z,r)-Fix,z,r) 

+ Csup|EF,(x,z,r) -F(x,z,r)||log(A„(z))| +E i i ^ In i . 

^ I, j=k2 ) 

(6.15) 

This implies that 

\ut! - < C\ log(A„(z))| sup |EF„(x, z, r) - F{x, z)\. (6.16) 

X 

Note that, for any r > 0, \sj{z) — Sj{z,r)\ < r. This imphes that 

EF„(x-r,z) <EF„(x,z,r) <EF„(x + r,z). (6.17) 

Hence, we get 

sup |E_F„(x, z, r) — F{x, z)\ < sup |E J"„(x, z) — F{x, 2;)|+sup \ F{x+r, z)-F{x, z)\. (6.18) 

X XX 

Since the distribution function F{x, z) has a density p{x, z) which is bounded for |z| > 

m— 1 

and p(x,0) = 0(x »"+i) (see Remark l2.7p we obtain 

sup I E (^X, Z,T ) -F{x,z)\ < sup\BTi^\x,z) -F{x,z)\ +Cr^. (6.19) 

X X 

Choose r = A„(z). InequaHties (|6.19p and (|6.18p together imply 

2 

sup\E Fn{x,z,r) - Fix, z)\ <CA™+^(z). (6.20) 

X 

From inequahties (j6.20p and (j6.16p and lemma [5^2] it follows that 



Note that 



\U^;!-U^\<CAr'{z)\lnAn{z) 



\U^/^! -U^\<\ r^^'^og xdF{x,z)\ < CA/+^(z)|ln(A„(z))|. 
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Let fC = {z £ C : \z\ < R} and let /C^ denote C \ /C. According to Lemma [53| we 
have, for ki and R from Lemma 15.51 



l-qn :=E^M(/C^) < :^ + Pr{|AfcJ >R}<C6l{z). (6.21) 

(^\ ^(r) 

Furthermore, let and fin be probability measures supported on the compact set K 
and K^'^^ respectively, such that 

E/.M = rf + (l-rfM. (6.22) 
Introduce the logarithmic potential of the measure /in , 

u^ir) = - 1 iog\z-c\dji^:\c). 

Similar to the proof of Lemma 16.11 we show that 

|C/£)-^-w|<CA|(z)|lnA„(z)|. 

This implies that 

lim U {r){z) = Uf,{z) 

for all z £ C According to equality (jl.l|) . Ufj,{z) is equal to the potential of the m-th power 
of the uniform distribution on the unit disc. This implies that the measure /i coincides 
with the m-th power of uniform distribution on the unit disc. Since the measures /Xn are 
compactly supported, Theorem 6.9 from [16| and Corollary 2.2 from |16] together imply 
that 

lim 7l([) = n (6.23) 

n— >-oo 

in the weak topology. Inequality (|6.2ip and relations (j6.22p and (j6.22p together imply that 

lim E iil^^ = 

n— >-oo 

in the weak topology. Finally, by Lemma 1.1 in [9], we get 

lim E = /X (6.24) 

in the weak topology. Thus Theorem 1 1.1 1 is proved. 

7 Appendix 

Define V,,^ ■=ULa^^''^- 

Lemma 7.1. Under the conditions of Theorem we have, for any j = 1, . . . ,n, k = 
1, . . . , n and for any 1 < a < /3 < m, 

E [Ya,^]jk = 
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Proof. For q = /3 the claim is easy. Let a < (3 and 1 < j < n, 1 < A; < n. Direct 
calculations show that 



^ ii=ii2=i i,3-c,=i 
Thus the Lemma is proved. 

In all Lemmas below we shall assume that 



EX^'f} =0, E = 1, < cTnV^ a. s. 



□ 



(7.1) 



with Tn = o(l) such that T„ '^Ln^Tn) < T^. 



Lemma 7.2. Assuming the conditions of Theorem \1.1\ as well as JY. i[ ), we have, for any 
I < a < /3 < m, 

E||V„,^||2 <Cn (7.2) 

Proof. We shall consider the case a < (3 only. Other case is easy. Direct calculations show 
that 



EIIV, 



a,l3\\2 



< 



c 



n n n P/3- 



i = lil=li2 = l i,3_a = l fc=l 

By independence of random variables, we get 

E||V,,;3||2 < Cn 

Thus the Lemma is proved. 



□ 



Lemma 7.3. Assuming the conditions of Theorem li.il as well as (7.1) we have, for any 
j = I, . . . n, k = 1, . . . ,n and r > 1, 



anc 



E ||Va^befc||2'' < Cr 



E ||eTVa^b||2'^ < Cr 



(7.3) 
(7.4) 



with some positive constant Cr depending on r. 

Proof. By definition of the matrices Va,b, we may write 



1 " 
-a+1 ^ 



1=1 



EST y('^> 

ja = l jb-l=l 



(7.5) 
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Using this representation, we get 



n n r I n n n n 



E||v„.e.iir = ;^E-EEn E^^^ E E- E ^Lu. ;., 

«1=1 1^ = 1 q=l \ja = l i6_l=lj^ = l jt-l = l 

(7.6) 

where 

ija,--.,jb3l,--;jb) jja jo.ja+1 jaja + 1 jb-2'jb~l jb-2jb-\ 3b-llq jb-llq' 

By X we denote the complex conjugate of the number x. Expanding the product on the 
r.h.s of (|7.6p . we get 

Eiiv„,.e,iir=E"Eri^j;:^;, m 

9=1 

where is taken over all set of indices ji^^ , • • • , J^l\ , Iq and ji^^ , • • • , i^i^ where j^^ , j^'^'' = 
1, . . . , Pfc, A; = a, . . . ,b— 1, = 1, . . . , and q = 1, . . . ,r. Note that the summands in the 
right hand side of (17. 7p is equal if there is at least one term in the product 17.71 which 
appears only once. This implies that the summands in the right hand side of (j7.7p are 
not equal zero only if the union of all sets of indices in r.h.s of (17. 7p consist of at least r 
different terms and each term appears at least twice. 

Introduce the following random variables, for u = a + 1, . . . ,b — 1, 

^,•(1) ,-(1) .(O^Cl) 7M 7(1) 7(r)-^ (l) (l)---^ (r) .(r)-^7(l) ^(l) ) ' " " ^ ^(r) ^(r) , 

(7.9) 

and 

Aa) _ -^(a) ^{a) ^(a) ^(a) 

Jl i---iJl iJi i---iJl JJl + 1 JJa Ja J a + 1 

Ab) _ ^{b) y{b) -yib) -yib) 

7(1) 7(r) , ~^.(i) ,-(1) ■■■"^.('■) , ^7(1) , '■■■^7('-) , • 

lb-i'---'lb-i'lb-i'---'h-i''-<i Ib-ih h-i'-q Jb-i''? Jb-i^'-q 

Let the set of indices jji^ , ■ ■ ■ , ja^ , j^^ , • • • , jl''^ contain ta different indices, say > • • • i 
with multiplicities k^i \ . . . , respectively, /cl""* + . . . + = 2r. Note that 
min{A;^"\ . . . , fc^^"^} < 2. Otherwise, |E(^^|\^) .(r)'>(i) '>(r)l = 0- By assumption (j7.ip . we 
have 

|ECS „ I < C(r„V^)2^~2*'' (7.10) 

Ja v'lja ija v?Ja 

A similar bound we get for |E(;^^['^^j .(rj-^ci) -^(r) I- Assume that the set of indices 
{ibJ*!, • • • ^ifoJ*!, ifoJ*!, • ■ ■ ^JfeJ*!} contains different indices, say, with 
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multiplicities 

^\ . . . , ^ respectively, + . . . A- = 2r. Then 

lECS, \<C{rr.^f-'^--^ (7.11) 

Furthermore, assume that for a + 1 < u <b — 2 there are tjy different pairs of indices, say, 
(ia,ia), . . . in the set 

{ja^ , • • • , , ja^ ,---,ja\---, ji-i , • • • , ji-i , , • • • , jj,- , ^1 , ^r} with multiphcities 
k[''\...,k'l''J. Note that 

k^^^ + . . . + kl'^^ = 2r (7.12) 

and 

ECji) M (1) .{r)^(i) 7M ^(1) ^(r) < C'('^n\/^) (7.13) 

The inequalities ([7T0]) - (f7?T3]) together yield 

lEn^-;, w.) I < C(r„V^)M^-)-2(*^+-+*-). (7.14) 

It is straightforward to check that the number M{ta-, . . . ,th) of sequences of indices 

Ua ,---,Ja ,Ja ,---,Ja 1 • • • 1 1 • • • 1 , 1 • • • , 1 '1 > • • • , 'r / Wltn Iq, . . . , If, OI OU- 

ferent pairs satisfies the inequality 

AA(^a,...,^fe)<Cn*"+■■■+*^ (7.15) 

with I < ti < r, i = a, . . . ,b. Note that in the case ta = ■ ■ ■ = h = r the inequalities 
(mO]) - (rm]) imply 

Ed(l) M (1) .(r)^(l) 7(r) - ^ C^-IS) 

The inequalities ()7.15p , ()7.14p , (I7.16P , and representation (|7.6p together conclude the proof. 

□ 

The Largest Singular Value. Recall that |A^'"^| > . . . > \\^^\ denotes the eigen- 
values of the matrix W ordered by decreasing absolute values and let s^^™'' > . . . > si'"'' 
denote the singular values of the matrix W. 

We show the following 

Lemma 7.4. Under the conditions of Theorem \l.l\ we have, for sufficiently large K >\ 

Pr{sS™) > n} < C/n (7.17) 

for some positive constant C > 0. 
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Proof. Using Chebyshev's inequality, we get 

Pr{sS"'^ > n} < ^ETr fwW*) < - (7.18) 

Thus the Lemma is proved. □ 
Lemma 7.5. Under conditions of Theorem \1.1\ assuming (7.1), we have 

E -(TrR- ETrR) < — ^. 

n nv^ 

Proof. Consider the matrix X^^'-'^ obtained from the matrix X^^^ by replacing its j-th row 
by a row with zero-entries. We define the following matrices 

H(-.i)=HM_e^.ejH('^), 

and 

^{m-v+i,j) ^ ^{va-v+i) _ H("-''+i)ej-+„eJ+„. 
For the simplicity we shall assume that u < m — u + \. Define 

v—l m—u m 

q=l q=v+l q=m—u+2 

Let \{v,j){z) = V(z^, j)J — J(z). We shall use the following inequality. For any Hermitian 
matrices A and B with spectral distribution function Fa{x) and Fb{x) respectively, we 
have 

|Tr(A - al)-i - TV(B - aI)-'\ < '^"''^'^ ~ (7.19) 

V 

where a = u + iv. It is straightforward to show that 

rank(V(z) - V^'''^\z)) = rank(VJ - V^'^'-'^J) < 4m. (7.20) 
Inequality ()7.19p and (|7.20p together imply 

I — (TVR-TrR('^'^'))| < — . 

After this remark we may apply a standard martingale expansion procedure. We 
introduce cr-algebras J^j = ^{^ik\ j < I < n,k = 1, . . . ,n; , q = u + 1, . . . m, p = 
1, . . . , n, fc = 1, . . . , n} and use the representation 

m n 

TrR- ETrR = ^ ^(E j.j_iTrR - E ^jTrR), 

u=l j=l 

where Eu,j denotes conditional expectation given the ci-algebra J^uj- Note that = 
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Lemma 7.6. Under the conditions of Theorem li.il we have, for I < a,< m, 

1 ^ n ^ 

n — ' — ' n?;^ 
k=i j=i 

and, for 1 < a, < m — 1, 

n n 
E | — (y^[Vm-a+2,mJRVl,-m-a+l]fc,fc — E [Vm-a+2,??t JRVl,m-a+l]fcfc) | ^ < - 



fc=l i=l 

Proof. We prove the first inequality only. The proof of the other one is similar. For 



= 1, . . . , m and for j = 1, . . . , n, we introduce the matrices, X^'"'-'-' = X^^^^ — ejejx^*^) 
and H(^'-') = H^"^) - ejeJU^"^ and 
^(m~u+i,j) ^ jj^im~u+i,j) _ H(™-'^+i)ej+„eJ_^_„. Note that the matrix X^'^'^) is obtained 
from the matrix X^''^ by replacing its j-th row by a row of zeros. Similar to the proof 
of the previous Lemma we introduce the matrices V^'^^'''' by replacing in the definition of 
Vc,d the matrix U'^"^ by H^'^'J) and the matrix h("'^''+i) by h(™-^+1j). For instance, if 
c < u < m — v + 1 < d we get 

m—v b 
q=a q=u-\-\ q=m—v+l 

Let V^'^'J') := Vj'';^^ and R(^) := (V^^'^Xz) - al)-^ . Introduce the following quantities, 
for V = \ . . . ,m and j = 1, . . . , n, 



n n 
k=l k=l 



We represent them in the following form 



^ ._ ^(1) , ^(2) , ^(3) 

"J . -r -r "J , 



where 



"^^] y^[(Va+l,m - V^'^-\-'_^)JRVi,m,-a+lJfc,fc+n, 

n 

fc=l 
k=l 
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Note that 

By definition of tlie matrices Jl'^'^ and H™^'^"'"^'-'' , we liave 

n 

,m—u+l]k,k+n ,m— a+1 

k=l 

,m—a+l'f'^ a+l,m—a+l\j+n,j+n^ 

where 

" Vo o 

This equality implies that 

+ |[Vm-i/+2,m.JKVi 

,m— a+lJ"^a+l,m— i/+l]j+nj+n| ■ 

Using the obvious inequality Yl]=i^'jj — ll-^lll niatrix A = (ojfc), j,k 

1, . . . , n, we get 



,m— a+l 



+ E ||Vm-!/+2,mJR-Vi^m-a+lJVa+i^m-r/+l||2- 



By Lemma 17.21 we get 



C Cn 
Ti < ^E ||Va+i m_a+i||2 < (7-21) 

V V 



Consider now the term 



n 



Using that R - R(j) = -R(j)(V(z) - V('''J)(z))R, we get 

n 

|Hf I < I ^[vi'^)jRVi,,„ie,-eJV,,™RVi,6]fc,fc+„| 
fc=i 

< [JH*-"^"^''Vc+2,m-aH'''" ""'"^'■^'''Vm_Q+2,m.KVi^m_.Q,V^^j^^^JRVi^c,]jj. 

This implies that 

t(2) < CE||[V,+i,^JRVi,bVa,™JRyi,,||i. 
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It is straightforward to check that 



r(2) < E ||Vi,„JH("+i) V,+2,m-aH("^-°+i'^')v„_„+2,m||i = E IIQIli 



(7.22) 



The matrix on the right hand side of equation (17.22^ may be represented in the foUowing 
form 



This imphes that 
Similar we prove that 



where = or = 1 or = 2. Since xis^ = 0, for x = 1 or x = 2, we have 

eihh:,p<^. 

n 

T2 < Cn. 

Inequahties (fTnl) . (f7:23]l and (f7:2i]l together imply 

n 

^E|S,f <C7n 
i=i 

Applying now a martingale expansion with respect to the cr-algebras Tj generated by the 
random variables X^^^^ with l<A;<j, l</<n and all other random variables 
except g = a + 1 , we get 



(7.23) 
(7.24) 



-j^ n n 

,m—a\kk+n ,m—a\kk+n)\ _ 



k=l 



c 



Thus the Lemma is proved. 



□ 



Lemma 7.7. Under the conditions of Theorem \l.l\ we have, for a = 1, . . . , m, there exists 
a constant C such that 



3 

712 



E 



n n 



j=l k=l 



,m— a+l) fai'^) vi<^)^ 



dX 



(a)' 
jk 



'^jk ^jk 



kj 
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and 

1 

f 
ri2 



E 



Pm — a Pin — Q.-\-l 

E E 

j=i k=i 



{m—a+l) T^(m.-o+l) 



52(V,+i,„JRVi 



{0 



jk 



jk 



j+n,k 



< CTnV-\ (7.25) 



where and are independent in aggregate for a = l,...,m and j = l,...,n, 

k = I, . . . ,n, and are r.v. which are uniformly distributed on the unit interval. 

By — A{6j'^^ Xj'^^ ) we denote the matrix obtained from — ^^^A by replacing its entries 

hyef^x%\ 

Proof. The proof of this lemma is rather technical. But we shall include it for completeness. 
By the formula for the derivatives of a resolvent matrix, we have 

<9( Va+l^m JRVl,m-a+l ) 



dX 



(a) 



jk 



1=1 



(7.26) 



Ql ——i=^a+l,m'^^^l,a~l^j^k'^oi+l,m~a+lI{a<m-a+l}) 
1 



Q2 
Q3 
Q4 



Vq+i,,„JRVi 

,m~a^k+n^j- 



1 



_ rp 



n 



1 



T 



Qs — , — ^a+l,m—a^k+prn-a^j+n^rn—a+2,rnJ^!^^l,m—a+lI{a<m—a+l})- 

Introduce the notations 



+l,m 



= V 



l,m— o+l ■ 



Prom formula (j7.26p it follows that 

52(UaJRV„) 



dX, 



dQi 

1=1 ox-^ 



E 



^jk '=J^ J* 

Since all the calculations will be similar we consider the case / = 3 only. Simple calculations 
of derivatives show that 



O^jk m=l 



(7.27) 
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where 



p(i 

p(2 
p(3 
p(4 
p{5 
p{6 
p{7 



\ rp rp 

1 T T 



n 

1 

n 
1 

n 



T T 

Uq JRVm_Q+2eje;, Vq,+i JRVc 



U A. J RVm _ 4- e 1 e I, U„JRV r. 



— UaJRVQ+iefc+„ej^„Um-o+i JRVm-a+2eje|'UQ,JRVo 
— UQ,JRVm-a+2eje;, UQjRVQ,+iefc+„ej_,_„Um-Q+i JRVo 

— UciJRVm-a+2eje^UQ,JRVm-a+2eje^UaJRVa. 



Consider now the quantity, for [i= 1, . . . , 5, 



n2 



(7.28) 



i=i fc=i 

We bound L3 only. The others terms are bounded in a similar way. First we note that 

T) n 

^3. 



EEe4^ ^^^^^^ = 0' for = 1,2,3. 

i=i fe=i 



(7.29) 



Furthermore, 



E |x]j'||[p(4)]fc,| < E |x]^)|3|[U,JRV^_«+2]fe,f |[UaJRV«]fc,-|. (7.30) 



Let Uo'^^ ( Vq''^^) denote matrix obtained from Uq (Vq,) by replacing X"^^ by zero. 
We may write 



m— Q+2,m- 



(7.31) 



and 



Using these representations and taking in account that 



(7.32) 
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we get by differentiation 

B\X^f\\[P'^%j\ < iE|4'^)'||[U,JRV^„«+2]fe,f |[U(^''^)jRVp)]fc,|. (7.33) 



n 



Furthermore, 



a\\2 



|[UaJRVm-a+2]fcj| < - || Vm-a+2ej ||2 ||efc U, 

|[u2»JRV(^-''=)]fc,| < i||v(f»e,||2||ejui^»||2. 



(7.34) 



Applying inequalities (j7.33p and (|7.34p and taking in account the independence of entries, 
we get 



(7.35) 

Applying Lemma 17.31 we get 



j=i k=i 

The assumption (|7.ip now yields 



^ n n „ n n 



(")|3 
jk I 



(7.36) 



j=i k=i 



^ n n 

n2 - I ,_i 



(7.37) 



j=i k=i 

Similar we get corresponding bounds for = 5, 6, 7 



n n 

^EEE|^]?n[P^%-|<t^Tn. 
j=l k=l 



and 



I-Z^mI ^ C*"^"' M = 1, • • • ,5. 



The bound of the quantity 



j=i fc=i 

is similar. Thus, the Lemma is proved. 



dX 



{a) 
jk 



kj 



(7.38) 



(7.39) 



(7.40) 



□ 



38 



Lemma 7.8. Under the conditions of Theorem \l.l\ we have 



^ ^ E x^i^ [Vj,+i,mJRVi,m-i/+i]fci - y^y^E 

j=l k=l j=l k=l 



and 



9V,+i,^JRVi 



dX 



jk 



kj 



,m—u+l]j+n,k 

j=l k=l 



j=l k=l 



av,+i,„jRVi 



dX 



jk 



+ en{z,a)), 



j+n,k 



where |e„(z,a))| < 

Proof. By Taylor expansion we have, 

BCf{o = f'mEe+Een0o, 

and 

/(0)=E/'(O+Eem) 



(7.41) 



where 9 denotes a r.v. which uniformly distributed on the unit interval and is independent 
on ^. After simple calculations we get 



j=l k=l j=l k=l 



<^Vt/+l,m.JRVl,m-i/+l 



kj 



j=l k=l 



52V,+i,™JRVi 



dX 



jk 



kj 



Using the results of Lemma 17.71 we conclude the proof. 



□ 
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I 

Abstract 

We consider products of independent random matrices with independent entries. 
The limit distribution of the expected empirical distribution of eigenvalues of such 
products is computed. Let x\'f} , 1 < j, r < n, = 1, . . . , to be mutually independent 

complex random variables with E Arj^-* = OandE|Aj^-'| = 1. Let X'"' denote annxn 

matrix with entries [X^'^^jjfc — --^Arjj^\ for 1 < j,k < n. Denote by Ai,...,A„ the 

eigenvalues of the random matrix W := n"Li ^^i^ define its empirical spectral 
distribution by 

1 " 

Tn{x,y) - V'llReAfc < x,lmXk < y}, 
n ^-^ 

k=l 

where I{B} denotes the indicator of an event B. We prove that the expected spectral 
distribution F^\x,y) = E J^^'"' (a;, y) converges to the distribution function G{x,y) 
corresponding to the m-th power of the uniform distribution on the unit disc in the 
plane R^. 



1 Introduction 

Let m > 1 be a fixed integer. For any n > 1 consider mutually independent identically 
distributed (i.i.d.) complex random variables 1 < i, ^ < v = l,...,m with 

EX]^^ = and E|X]^^| = 1 defined on a common probability space (i7„,F„,Pr). Let 

^Partially supported by RF grant of the leading scientific schools NSh-638. 2008.1. Partially supported 
by RFBR, grant N 09-01-12180 and RFBR-DFG, grant N 09-01-91331. Partially supported by CRC 701 
"Spectral Structures and Topological Methods in Mathematics", Bielefeld 



1 



X^*^^ denote an n x n matrix with entries [X^''-*]jfc = -^xj^ , for 1 < j, A; < n. Denote by 

Ai, . . . , A„ the eigenvalues of the random matrix W := HiILi ^^'^^ and define its empirical 
spectral distribution function by 

1 " 

J^n{x,y) = - V]l{ReAfc < x,ImAfc < y}, 

k=l 

where I{B} denotes the indicator of an event B. We shall investigate the convergence 
of the expected spectral distribution Fn{x,y) = EJ^nix,y) to the distribution function 
G{x, y) corresponding to the m-th power of uniform distribution on the unit disc in the 
plane with Lebesgue-density 

9{x, y) = — Tv^— T^^i^' + y^^ 

We consider the Kolmogorov distance between the distributions Fn{x,y) and G{x,y) 

An := sup \Fnix,y) - G{x,y)\. 

The main result of this paper is the following 

Theorem 1.1. LefEX^l^ = 0, E = 1. Then, for any fixed m>l, 

lim sup \Fnix, y) - G{x,y)\ =0. 

The result holds in the non-i.i.d. case too. 

Theorem 1.2. LetEX^^l^ = 0, E = 1 and assume that the random variables X^^^ 

have uniformly integrable second moments, i. e. 

maxE\xll^\^I{\xll^\> M} ^0 as M ^ oo. (1.1) 

u,j,k ■' 

Then for any fixed m > 1, 

lim sup|F„(x,y) - G{x,y)\ = 0. 

n^oo x,y 

Definition 1.3. Let /-fn(-) denote the empirical spectral measure of an n x n random 
matrix X and let /i(-) denote the uniform distribution on the unit disc in the complex 
plane C. We say that the circular law holds for random matrices X if E/i„(-) converges 
weakly to the measure /i(-) in the complex plane C. 

Remark 1.4. For m = 1 we recover the well-known circular law for random matrices [9], 

m- 

Theorems II . II and 1 1 . 2 1 describe the asymptotics of the spectral distribution of a product 
of m independent random matrices. This generalizes the result of [9] and |15j . 
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1.1 Discussion of results 

The proof of these results are based on the author's investigations on asymptotics of the 
singular spectrum of product and powers of random matrices with independent entries 
(see [T], [2], [3]). Our results give a full description of the complex spectral distribution 
of products of large random matrices. The results mentioned on the asymptotic distribu- 
tion of the singular spectrum of products of independent random matrices where already 
obtained some time ago by the authors, see [2], [1]. Related previous results concerned 
bounds for the expectation of the operator norm of two independent matrices, see Bai 
(1986), [5]- In Bai (2007), [J, the asymptotic distribution of the product of a sample co- 
variance matrix and an independent Wigner matrix is investigated. Some questions about 
the asymptotic distribution of products and powers of random matrices were studied in 
Free Probability. For example, in Banica et al. (2008), [7], the asymptotic distribution 
of the singular value distribution of the product of squares of independent Gaussian ran- 
dom matrices is determined. In Speicher (2008), |14j . the same asymptotic distribution 
has been obtained for the singular value distribution of products and powers of random 
matrices. 

A related result for norms has been obtained by Haagerup and Torbj0nson jlOj . who 
proved that if X^^^ , ■ ■ ■ , X^™) is a system of independent Gaussian random matrices and 
xi, . . . , Xr- is a corresponding semi-circular system in a C* probability space, then for every 
polynomial p in r non commuting variables we have an asymptotic norm equality 



which holds almost surely. 

Our result on the asymptotic distribution of the complex eigenvalues of products of 
large (non-Hermitian and non Gaussian) random matrices seemed to be new. After finish- 
ing this paper we learned though that the case of products of Gaussian had been studied 
by Burda et al. (2010), [6j, with our main result stated as conjecture, supported by 
simulations. 

We expect that results of this type will be useful for the analysis of some models of 
wireless communication. See for instance, jllj . 

The results of both Theorems 11.11 and 11.21 may be considered as generalizations of the 
circular law, see e.g. [9] for some history on the circular law and its proof. 

To prove the claim of both Theorems 11.11 and 11.21 we use the logarithmic potential 
approach as in [9]. We may divide this approach into two parts. The first part deals with 
the investigation of the asymptotic distribution of the singular values of shifted matrices 
W{z) := W — zl. To study these distributions we use the method developed in [3] for the 
case z = 0. The other part will be the investigation of small singular values of matrices 
W(z) for any z £ C This problem may be divided again in two parts. The first part 
consists of the investigation of smallest singular values. Here we may use our results in [9] 
or the results in |15j . The second part deals with the investigation of the singular values 
between the smallest one to the jth smallest one, where j > n — n'^ for some < 7 < 1. 
Here we use a modification of techniques of Tao and Vu in [15] . 




(1.2) 
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In the remaining parts of the paper we give the proof of Theorem 11.21 Theorem 11.11 
follows immediately from 11.21 We shall use the logarithmic potential method which is 
outlined in detail in [9]. 

In Section [3] we derive the approximation of the singular measure of the shifted matrix 
W(2;) for any z £ C This allows us to prove the convergence of the empirical spectral 
measure of the matrix W(z) to the corresponding limit measure in M^. The convergence 
is proved in Section [H 

In the what follows we shall denote by C and c or 6, p, rj (without indices) some general 
absolute constant which may be change from one line to next one. To specify a constant 
we shall use subindices. By I{A} we shall denote the indicator of an event A. For any 
matrix G we denote the Frobenius norm by ||G||2 and we denote by ||G|| its operator 
norm. 

Acknowledgment. The authors would like to thank Sergey Bobkov for helpful dis- 
cussions concerning Maurey's result and Gemot Akemann for drawing our attention to 
the paper [6]. 

2 Auxiliary Results 

In this Section we describe a symmetrization of one-sided distribution and a special repre- 
sentation of symmetrized distributions of squares singular values of random matrices and 
prove some lemmas about a truncation of entries of random matrices. 

2.1 Symmetrization 

We shall use the following "symmetrization" of one-sided distributions. Let be a positive 
random variable with distribution function F{x). Define ■= £^ where e is a Rademacher 
random variable with Prj^e = ±1} = 1/2 which is independent of S,. Let F{x) denote the 
distribution function of It satisfies the equation 

F{x) = 1/2(1 + sign{rc} F{x^)), (2.1) 

We apply this symmetrization to the distribution of the squared singular values of the 
matrix W(z). Introduce the following matrices 

Here and in the what follows A* denotes the adjoined (transposed and complex conjugate) 
matrix A and O denotes the matrix with zero-entries. Consider matrix 

V(z) := VJ- J(z). (2.2) 

Note that V(z) is a Hermitian matrix. The eigenvalues of the matrix V(z) are — si, . . . , —Sn, 
Sn, ■ ■ ■ ,si. Note that the symmetrization of the distribution function J-nix, z) is a function 
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J-'n{x,z) is the empirical distribution function of the non-zero eigenvalues of the matrix 
V(z). By ^J^, we have 

An = SUp\Fn{x,z) - G{x,z)\, 

X 

where Fn{x,z) = EJ>i(x,z) and G{x,z) denotes the symmetrization of the distribution 
function z). 

2.2 Truncation 



we shall assume that the random variables Xj'^ satisfy the following Lindeberg condition: 



We shall now modify the random matrix X*^'') by truncation of its entries. In this section 
we shall assun 
for any r > 

1 " 

L„(r) = max ^ y E \X^l^\'^I{\x'^l^\ > r^^} ^0, as n^oo. (2.3) 

l<u<m n ^ — ' -' 

It is straightforward to check that this Lindeberg condition follows from uniform integra- 
bility. We introduce the random variables X^'^,^^^ = X^X} I r,^Av), ^ with Tn — >■ and 

the matrices X^'^''^) = -^(x]^'"^) and W^^) := IlILi^^'''"^- Denote by ^ > . . . > s'h^ 

( ) ( ) f O \ 

the singular values of the random matrix W^'^'' — zl. Let V^'^'' := _ t \* ] ■ 

\ O W'^'^'' / 

We define the empirical distribution of the matrix V'^'^^z) = V'^'^^J — 3{z) by Fn\x) = 
Wi Sfc=i ^{^k^ - ^}+^ Z]fc=i ^ Let s„(q, z) and Sn\a, z) denote the Stieltjes 

transforms of the distribution functions Fn{x) and Fn\x) = Y!iFn\x) respectively. De- 
fine the resolvent matrices R = {y{z) — q1)~^ and R^'^-* = {y^^\z) — where I 
denotes the identity matrix of corresponding dimension. Note that 

s„(a,z) = — ETrR, and s^'^Vq, z) = — ETrR^'^). 
2n 2n 

Applying the resolvent equality 

(A + B - al)-^ = (A - al)-^ - (A - aI)-'^B{A + B - aI)-\ (2.4) 

we get 

\sn{a,z)-sl^\a,z)\ < ^E |TrRW(V(z) - vW(z))JR|. (2.5) 

2n 

Let 

XH O \ „iu,c)_( XC'^.^) O 

^ - 1^ O and ' ^ - ^ ^i.m-u+i,cy 

Introduce the matrices 

q=a q=a 
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We have 



V(z) - V('=)(z) = [V- v(^)]j 



m—1 



q=l 



(2.6) 



Applying max{||R||, ||R(^)||} < v ^, inequality (|2.5p . and the representations (|2.6p to- 
gether, we get 



-s(f)(a,z)| < -= j;Ei||(X(''+i) -X('?+i''=))||i-=E^||vg_iRR(^)V,+i 
0=1 



||2 
m||2- 



By multiplicative inequalities for the matrix norm, we get 



E||vg_iRRWv,+i,^||2 < 



r{c) 



Applying the result of Lemma 17.21 we obtain 



E||vg_iRR('=)V,+i,„||i<^. 



Cn 



Direct calculations show that 



1 r " 

Ie ||X<.) - X<-)||^ < ^ E E |X,'?P/,„<.,,^„,^, < CLJr, 



j,k = l 



Inequalities (H^D, <^M and[2J]) together imply 

\Snia,z) - sl^\a,z)\ < '^V-^ri(Tn) ^ 
(c) 

Furthermore, by definition of X^^: , we have 



1 



This implies that 



C 



Ex(-)iiB^EEiE^]rp< 



('?.c)|2 ^ CLn{Tn) 



j=l k=l 

Corresponding to H^'^''^^ introduce H^*^'^) 



(2.7) 



(2.8) 



(2.9) 



(2.10) 



(2.11) 



O 



O (X(^''=) - EX^'^''^))*;' 

and for the matrices W^'^) , V'^'^^ , V^*^^ define matrices W^'^) , V^*^) , V^'^^ respectively. Denote 



by J'n'^ {x) the empirical distribution of the squared singular values of the matrix V^'^^ ( 



z :-- 



6 



V^'^^J — J{z). Let s^\a, z) denote the Stieltjes transform of the distribution function 

f°° 1 ~ 



X — a 



Similar to inequality (I2.7P we get 

1 



|.(f)(a,z) -5<f)(a,z)| < -^||EX(«'^)||2-^Ei||v(2R(^)R(^)v;5, 
Similar to inequality ()2.8p . we get 



||2 

g=0 



By inequality ([2TT]) . 



||EX(''''^)||2 < 

The last two inequalities together imply that 



CT„. 



\s(:Ha,z)-^Ha,z)\ < £^3^ < ^ (2.12) 

Inequalities (j2.10p and (j2.12p together imply that the matrices W and W^*^) have the same 
limit distribution. In the what follows we may assume without loss of generality for any 
= 1, . . . , m and j = 1, . . . n, /c = 1, . . . , n and any / = 1, . . . , m, that 

Exj^) = 0, ^Xff = 1, and \xf^\ < cr^^ (2.13) 

with 



Ln{Tn)/Tl < Tn- 



3 The Limit Distribution of Singular Values of the Matrices 
V(^) 

Recall that Hi") = ( ^""^ xC""*')*) ( ^1 'o)-^ '= 

I < y < ^ < m, put 

^^ 

k=v 

and 

V(z) := VJ- J(z). 
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We introduce the following functions 

Sn{a, z) = - ^ E [R(a, z)]jj = - X] ^ Ma, z)]j+nj+n = 7^^.^ t^^"' 
j=l j=l j=l 

-j^ n 1 " 

tn(a,z) = -^E[R(a,z)]j+nj, nn(a, z) = - ^ E [R(q;, (3.1) 
^ i=i " j=i 

Theorem 3.1. // the random variables X^^^ satisfy the Lindeberg condition i2.3\) . the 
following limits exist 

y = y{z,a)= lim Sn{a,z), t = t{z,a)= lim tn{a,z), 
and satisfy the equations 

l + wy+ (-l)™+l«;'"-ly'^+l = 0, 

y{w — a)^ + {w — a) — y\z\'^ = 0, 

w = a + —. (3.2) 

y 

Remark 3.2. Since the Lindeberg condition holds for i.i.d. random variables and for 
uniformly integrable random variables the conclusion of Theorem 13.11 holds by Theorem 
Oand Theorem O 

Proof. In the what follows we shall denote by e„(a, z) a generic error function such that 
\enia,z)\ < for some positive constants C,p,r. By the resolvent equality, we may 
write 

1 + asn(a, z) = — E Tr V(z)R(a, z) = — E Tr VJR(a, z) — ztn(a, z) — zUn(o:, z). (3.3) 
2n 2n 

In the following we shall write R instead of R(a, z). Introduce the notation 

^:=— ETrVJR (3.4) 
2n 

and represent A as follows 

A=]^Ai + ^A2, (3.5) 

where 

Ai = -Y,^ [VJR]jj , A2 = -J2^ [VJR],+„j+„. 

By definition of the matrix V, we have 

1 " 

= n ^ EX];)[V[2HJR]fci- (3-6) 
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Let ei, . . . , e2n be an orthonormal basis of M . Note that 

av[2,^] JR _ ^ 

(Y) — V [2,m-l]6fc+nej+„J-rl. 

- V[2^m] JReje^V[2^m] JI^ - V[2^m] JK^[i^„_i]efc+„eJ^_„JR. (3.7) 
Applying now the Lemmas 17.81 we obtain 

n 1 

^1 = ^ E [V[2^m] JRV[i_„,_i]]fcfe+„- ^ E [JR]j+„j + e„(z, a). (3.8) 

^ fc=i j=i 

Introduce the notation, for v = 2, . . . ,m 

1 

fu = - ^ E [V[^^„] JRV[i^,„_,^_j,i]]jj+„ (3.9) 
i=i 

We rewrite the equahty (jS.Sp using these notations 

Ai = -f2Sn{a,z) + en{z,a). (3.10) 



We shah investigate the asymptotics of f^, for j> = 2, . . . , m. By definition of the matrix 

1 " 

/i/ = — ^ ■^"'^ifc [V[;^+l,m]JRV[i^„„^4.1]]fcj+n (3-11) 



V 

[y,m] ! W6 have 



n 
k,j=i 



For simphcity assume that u < m — v. Then 



T 



T 



- ^ [u+l,m]^^^ [l,v-l]^j^k^ [u+l,rn]^^^ [l,m-u+l] 

~ ^ [u+l,m]'^'^^ [l,m.-v]^k+n^"j+n^ [m-u+2,m\^'^^ [l,m~u+l\ (3.12) 

Applying the Lemmas 17.81 again, we get 
1 " 

/j^ = - X] E [V[j,+i^^] JRV[^^_j,]]fcfc+„ 

k=l 

^ n 1 " 
^ E [V[^^i^„] JRV[i^„^_j,]]fcfc+„— ^ E [V[„„,^+2,m] JRV[l,m-!/+l]]i+nj+n 

^ k=i i=i 
1 " 

= /iz+lll X!/"^ [V[m.-i/+2,m] JRV[l,m-i/+l]]j+nj+n) (3.13) 
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Note that 

— ^ E [V[m-u+2,m]-^'^^[l,m-u+l]\j+nj+n = — ^ E [V[i^,„] JR] (3-14) 



Furthermore, 

1 " 

- [V[i_„]JR]j+„j+„ = l + asnia,z) + zun{a,z). (3.15) 

Relations (|3.12p - (j3.15p together imply 

fu = fu+ii-OiSn{a, z) - zun{a, z)) + en{z, a). (3.16) 

By induction we get 

/2 = {-ir~\asn{a,z) + zun{a,z)y"'-hn{a,z)+en{z,a). (3.17) 
Relations (j3.10p and (13.17P together imply 

Ai = (-l)™(as„(a, z) + zun{a, z))'^~'^ sl{z , a) + en{z, a). (3.18) 
Similar we get that 

92 = i-ir~HaSn{a, z) + zt„(a, z))"^"^ Sn{oi, z) + e„(z, a). (3.19) 

and 

A2 = (-l)'"(as„(a, z) + ztn{a, z))™-!^ (z, a) + e„(z, a). (3.20) 
Consider now the function tn(ct) z) which we may represent as follows 

1 

atn{a, z) = - ^ E [V(z)R],+„,-. (3.21) 

By definition of the matrix H'^"'^-' , we may write 

1 " 

atn{a, z) = -Y, ^^jk^^M^^h+nk - z Sn(a, z). (3.22) 

^ j,k=l 

For the derivatives of the matrix Vj2,m]JR- by we get 

9V[2,m]JR y 
:(;^ = V[2,,„_i]ejefcJR 



V[2,m] JR-efc+„eJ+„V[2_m] JR - V^,™] JRV[i^„_i]eje^JR. (3.23) 
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Relation p.23p and Lemmas (|7.8p together imply 

^ n 1 " 

atn{a,z) = -- [V^2,mlJRV[i,m-i]]j+nj- [Rjfc+nfc -zSn{a,z) +en{z,a) 

j=l k=l 
= §2 tn{a, z) -z Sn{a, z) + en{z, a). (3.24) 

Applying equality (13.19p . we obtain 

atnia,z) = {-l)'^{asn{a, z)+zun{a, z))''^~'^Sn(a, z)tn{a, z)-z Sn{a, z)+eniz,a). (3.25) 

Analogously we obtain 

au„(a, z) = (-l)'"'(as.„(a, z)+ztn{a, z))"^~'^Sn{o:, z)un{a, z)-z s„(a, z)+en{z, a). (3.26) 

Multiplying equation (|3.25p by z and equation (j3.26p by z and subtracting the second one 
from the first equation, we may conclude 

ztn{a, z) = zun{a, z) + e„(z, a). (3.27) 

The last relation implies that 

Ai=A2 + en{z,a). (3.28) 
Relations (fOD . IXTHD . (Km . (Km and ([3:28]) together imply 

1 + a s„(a, z) = (-l)'"(as„(a, z) + z t„(a, z))"^~^ sl^{z, a) - z tn{a, z) + en{z, a). (3.29) 

Introduce the notations 

t \ I ^n(Q^) -2) /„ „„x 

Vn := Sn{a,z), tt;„:=aH . (3.30) 

Vn 

Using these notations we may rewrite the equations (j3.29p and p.27p as follows 

1 + WnVn = (-l)™C+'<"' + ^n{z, a) 

{Wn -a) + {Wn - afVn " ^nkP = £n{z, o). (3.31) 

Let n,n' — )• oo. Consider the difference y„, — From the first inequality it follows that 
I _ ^ \en,n'{z,a)\ + \wn - Wn'Wvn + {-ir^'yT\<~' + " " " + .3 

" \wn + {-ir+^yT\wn + {-i)^+^w^~\y^ + --- + y':,)\ 

Note that max{|y„|, |yn'|} — ^ ^'^'^ niax{|t(;„|, |tt;„'|} < C + v for some positive constant 
C = C{m) depending of m. We may choose a sufficiently large vq such that for any v '>vq 
we obtain 

|e„,„/(z,a)| C 

yn - yn' < \ \Wn- Wn'\- (3.33) 

V V 
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Furthermore, the second equation imphes that 

{Wn - Wn')il + yn{Wn + Wn' " 2a)) = [Vn - yn'){{Wn " af - |zp) +e„,„'(z,a). (3.34) 

It is straightforward to check that max{|t(;„ — a|, \wni — a|} < (1 + |en(-2j ci)|)|z|. This 
imphes that there exists vi such that for any v >vi 

\wn -Wni\ < \en,n'{z,a)\ + 4\zf\yn - y'J. (3.35) 

Inequahties (j3.33p and (|3.35p together imply that there exists a constant Vq such that for 
any v >Vo 

lyn-y'nl <\^n,n'{o:,z)\, (3.36) 

where e„.„'(a,z) — )• as n — )• oo uniformly with respect to > Vq and \u\ < C {a = 
u + iv). Since yn-,yn' are locally bounded analytic functions in the upper half-plane we 
may conclude by Montel's Theorem (see, for instance, [8], p. 153, Theorem 2.9) that there 
exists an analytic function yo in the upper half-plane such that limyn = yo- Since yn are 
Nevanlinna functions, (that is analytic functions mapping the upper half-plane into itself) 
yQ will be a Nevanlinna function too and there exists some distribution function F[x^ z) 
such that yo = X!^ ■^dF{x, z) and 

A„(z) := sup |F„(a;, z) — F(x, z)| — > as n — oo. (3.37) 

X 

The function y^ satisfies the equations (|3.2|) . 
Thus Theorem 13.11 is proved. 

□ 

4 Properties of Limit Measures 

In this section we study the measure -F(x, z) with Stieltjes transform s{a, z) = jr^ll^ F'ix, z) 
satisfying the equations 

l+wy + (-l)'^+l«;'"-ly'"+l = 0, 

y{w - af + {w - a) - y\z\'^ = Q. (4.1) 

Consider the first equation in ()4.ip with w = u + ^/—l v. Assume that there are two 
solutions of these equation, say yi and y2, which are Stieltjes transform of some measures. 
Then we have 

(yi - y2)w + (-l)"^+l^™-^(yi -y^){y-- + ...+ y^) = 0. (4.2) 

Note that 

Im{(-l)'"+^w;""-iy™} > 0, j = l,2. (4.3) 
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Indeed, by equation (|4.ip 

lm{{-ir+'w"^-'yj^} = ^-^-v>v f iJ^ '5 - > 0. (4.4) 

Note that if Im^™ > for j = 1,2 then lm{^^^!^~^} > for every k = 0,...,m. This 
impHes that 

lm{{-ir+^w'^-^y'ly^~''} > 0. (4.5) 

From here it follows that 

\w + i-ir+^w'^-^y"' + ■■■ + yT)\ >v>0 (4.6) 

and 

2/1 = 2/2- (4.7) 

It is well-known that the Stieltjes transform of a distribution function F{x) with moments 
given by the Fuss-Catalan numbers FC{m,p) = ^p_)_p (^^^^) satisfies the equation (|4.ip 
(see, for instance, [T]). This distribution has bounded support given by < Cm '■= 

(m+l)'"+i 



The second equation has a solution 



-1 + ^1 + 47/2^2 

w-a = ^ , (4.8 

with Im{t(; — q} > and — a| < 

Corollary 4.1. Letp{x,z) denote the density of the measure v{x,z) with Stieltjes trans- 
form s{a,z). Then, for any \z\ and \x\ > Cm + \z\, we have 

p{x,z)=Q (4.9) 

Otherwise p{x, z) > holds. For z = we have 

m— 1 

p{x,z) = 0{\x\ '"+i) as x^O. (4.10) 

It is straightforward to check that the logarithmic potential of the measure /x^"^^ (the 
m-th power of the uniform distribution on the unit circle) satisfies 

I — log Izl, Izl > 1 , , 

^M(™)(^) = Un \ \~,- (4-11) 

^ I y(l - \z\m), \z\ < 1 



Corollary 4.2. For x = we have 

( 

s(0,z) = 



0, \z\ > 1 

(4.12) 



j \/l-\z\^ 



Z < 1 
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We investigate now the connection of family of measures with the distribution 

of where (" is uniformly distributed on the unit disc in the complex plane. We prove 
the following Lemma. 



Lemma 4.3. For z = u + iv we have 

ds{x,z) s{x,z) ds{x,z) 



du y/l + 4|z|2s2(x,z) dx 
Proof. Let y = s{x,z). Denote by Ri{y,w,z), i = 1,2 the functions 

R,: = R,{y,W,Z,x) - 1 + + 

i?2 := R2{y, w, z, x) := (w - x)'^y + {w - x) - \z\^y. 
Differentiating both functions with respect to x and by u, we get 

dy —'^yu dRi 

aw ay aw ay 

dy —2{w — x)y — 1 dRi 

It follows immediately that 



dx 9R,aR2 _ m^dRi 

aw ay aw ay 



dy —'^uy dy 

du —2{w — x)y — Idx 
Taking in account the equality (|4.8p . we get 



(4.13) 



(4.14) 



(4.15) 



dy „ y dy 

-77- = — =— — , (4. lb) 

du ^l + 4|z|2y2 dx' ^ ' 

which completes the proof. □ 
Introduce now the function 

/oo 
log |x|(iz^(2:, x). 
-00 

Lemma 4.4. The following relation holds 

V{z)=U^,r.,{z). 

Proof. We start from the simple equality, for z = u + if , 

dU^(,n){z) _ j kl > 1 

du I " 7T1-1 ; < 1 

We prove that 

dVjz) ^ dU^jz) 
du du 
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Let A{x) = —\/—ls{z, \/—lx), where x > 0. The symmetry of function z^(z, y) in y imphes 
that the function A(a;) will be real and non-negative. We have 



By Corollary 14.21 we have 



1^1 

Note that lim^^-^oo A(x) = 0. We consider integral 

fC 



B{C,z) = [ A{x)dx. 
Jo 

Using the representation ()4.17p . we get 

B{C,z) = - log\y\p{y,z)dy + - log{l + ■^)p{y, z)dy + log C. (4.19) 
We rewrite this equality as follows 

V{z) = B{C, ^) + ^ /" log(l + ^)piy, z)dy + log C, (4.20) 



which implies 

du 

According to Lemma 14.31 we get 

aA(x) 2^iA(2;) aA(x) 



^VW = -B(C,.) + -- y_ Jog(l + y,(y,.),y^ (4.21) 



(4.22) 



9m v^1-4|z|2A2(x) 9x ' 

Note that the quantity A(x) satisfies < A(x) < ^jTy • There exists a point xq such that 
A(xo) = Thus we get 

^ A{x)dx= ^A{x)dx = 2u ^ ' =^A{x)dx (4.23) 

duJo ^ ' Jo du ^ Jo ^l-4|z|2A2(x) dx ^ ' ^ ' 



2|z|2 



A(o) Ja{C) J a/1 - 4a2|z|2 

1 - 4|z|2A2(C) + x/l - 4|z|2A2(0)) (4.24) 
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Simple calculations show that in the limit C — t- oo, we obtain 

lim — 5(C,z) = lim — / ^{x)dx={ , ^ . (4.25) 

C^oo Bu ^ ' C^oo Bu Jq ^ ' I if |z| > 1 ^ ' 

\ \A >" 

Consider now the quantity 

rj /'OO 2 

^(C^) = ^ y log{l + ^My,z)dy. 
By Corollary 12.71 we have 

A{C) = —J log (^1 + ^2 J (4.26) 



-2:3 

Using equality p{y,z) = Ims(z,y), we may rewrite equality (|4.26p as follows 

rCo 
-Co 



A{C) = Im jy J log (^1 + ^s{z,y)dy^ . (4.27) 
Applying Lemma 14.31 we get 

MO = to I log (l + ^'fa-->0 . (4.28) 

2 2 

Integrating by parts and using the inequality | log(l + ^)| < with some constant 
7 > 0, and |s(2Co,-<;)| < and |s(0, z)| < we conclude that 

lim A{C) = 0. (4.29) 

C^oo 

Collecting the relations (I4.2ip , ()4.25p , and (I4.29P concludes the proof of the Lemma. □ 

5 The Minimal Singular Value of the Matrix W — zl 

Recall that 

m 

w = JJx^'^), 

where X^^^ , . . . , X^™") are independent nx n matrices with independent entries. Let 
W(z) = W — zl and let s„(A) denote the minimal singular value of a matrix A. Note 
that 

s„(A) = inf IIAxlh. 

x:||x|| = l 
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Introduce the matrix W(i) = 0^=2 ^'■''^ ■ We may write 
s„(W(z)) = inf ||W(z)x||2 > inf ||(x(^) - z(w(i))-^)x||2 inf HW^^^xHs. (5.1) 

x:|jx|| = l x;||x|| = l x:||x|| = l 

By induction, we obtain 

m 

Sn{yV{z)) > 5„(X(1) - Z(W^'Y')) n (5-2) 

Lemma 5.1. Let X^^^} be independent complex random variables with 'EiXjk = and 
E|Xjfcp = 1, which are uniformly integrable , i.e. 

maxE|x]^^|2/||^^.^l>^^^0 as M ^ oo. (5.3) 

Let K > 1. Then there exist constants c,C,B > depending on 9 and K such that for 
any z G C and positive £ we have 



Pr{s„ < e/n^; max si(x('')) < Kn} < exp{-c n} H , (5.4) 

l<u<m Jn 



where Sn = s„(W(z)). 

Proof. The proof is similar to the proof of Theorem 4.1 in [9]. Applying inequality (j5.2p . 
we get 

P^{sn < e/n^; max si(X('')) < Kn} 

l<i/<m 

< Pr{s„(X(i) - z(W(i))"i) < £^n^^; max SiiX.^"^) < Kn} 

l<u<m 

m 

+ VPr{s„(X('')) < e^n-i; max siiX.^"^) < Kn}. (5.5) 



l<u<m 

v=2 



Furthermore, 



Pr{s„(X(i) - z(W(i))~i) < e-n"™; max si(X('')) < Kn} 

l<u<m 



< Pr{s„(xW - z(wW)-i) < s^(xH) < Kn; si(wW ^) < 7i^} 

+ Pr{si(w(^)"^) > n^; max si(X('')) < Kn}. 



l<i/<m 

(5.6) 



Note that 

m m 

si(w«"') < n ^iix^'')"') = n ^uH^^"^)- (5.7) 



!^=2 u=2 
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Applying this inequality and Theorem 4.1 in [9], we obtain 



Pr{si(wW ^)>n^; max si(x('^)) < Kn} < exp{-c n} + '^^^ 



(5-8) 



with some positive constants C, c > 0. Moreover, adapting the proof of Theorem 4.1 in 
[H], we see that this theorem holds for all matrices X^^^ — zB uniformly for all non-random 
matrices B such that ||B||2 < Cn^ for some positive constant Q > 0, i.e. 

Pr{s„(X(i) - zB) < en-^, si(X(i)) < Kn} < exp{-c n} + (5.9) 



with a constant depending on C and Q and not depending on the matrix B. Since the 
matrices X^^^ and W'^^-' are independent, we may apply this result and get 



Pr{s„(x(^)-zW(^) ^ < en-^, sifX^^h < Kn; sUW^^^ ^ < Cn^} < exp{-c n}+^^^ 

(5.10) 

Collecting the inequalities (|5.5p - (|5.10p . we conclude the proof of the Lemma. 

□ 



Following Tao and Vu [15] , we may prove sharper results about the behavior of small 
singular values of a matrix product. 

We shall use the following well-known fact. Let A and B be n x n denote matrices 
and let si(A) > • • • > Sn(A) resp. (si(B) > • • • > Sn(B) and si(AB) > • • • > Sn(AB)) 
denote the singular value of a matrix A (and the matrices B and AB respectively). Then 
for any 1 < A; < n we have 

n n 

lls,{AB)>l[sj{A)s,{B), (5.11) 

j=k j=k 

and 

n n 

J{sj{AB) = \{s,{A)s,{B) (5.12) 
i=i 3=1 
(see, for instance [12], p. 171, Theorem 3.3.4). 

We need to prove a bound similar to the bound (45) in |15| . namely: 

^ n—n^ 

lim - V lns,(W - zl) = 0, (5.13) 

j=n-n5n 

for any sequence 5n — )• 0. To prove this bound it is enough to prove that for any v = 
1, . . . ,m and any fixed sequence of matrices M„ with ||M„,||2 < Cn^ for some positive 
constant B > 

^ n—n'' 

lim- y lns,(X('') +M„) =0. (5.14) 

n— s>oo n ^ — ' 

j=n-n5n 
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Indeed, it follows from (|5.1ip . that 

m—l n—n^ 



^ I li I li ^ I I L J.((. I 1/ ^ I 1/ (t 

- InSj(W-zI) > - ^ lnSi(X('^^) + - lnSj(X("^)+M„), (5.15) 



j=n— no„ i/=i j=n— no„ j=n—nd„ 



where M""*^ = Oil^i^ -^^"^^ ■ Note that the matrices X^"^'^ and M„ are independent and 
it follows from our results in [S], Lemma Al, that ||M„||2 < Cn^ for some B > with 
probability close to one. The relations 

^ n— 

lim — In SofX^*^^) = 0, for v = l,...,m — l, 

n— 5>oo n ^ — ' 

j=n—n5„ 

^ n—nT' 

lim- y lns,(X("^) +M„) =0 (5.16) 

n— >co n ^ — ' 



j=n~nO' 



follow from the bound 



SjiX^"^ + Mn) > c\/^^^-^, 1 < j < n - n^. (5.17) 



To prove this we need the following simple Lemma. 

Lemma 5.2. Let lim,„_j.oo Sn = and let Sj, for n — n5n < j < n — with < 7 < 1 
denote numbers satisfying the inequality 



Sj>c\- — -. (5.18) 
V n 

Then 

lim - V Ins,- = 0. (5.19) 

n— >oo n ^ — ' 

n—nSn^j^Ti—nri 

Proof. Without loss of generality we may assume that < Sj < 1. By the conditions of 
Lemma 15.21 we have 

0>- V Ins. >- V ln{^^} = A (5.20) 
n ^ ^-^ n ^ ^-^ n 

n—nOn<j<:n—n~f n—nOn<j<:n~ni 

After summation and using Stirling's formula, we get 

< (5„| ln(5„| + (1 — 7)n'^~^ Inn — )■ 0, as n — )• 00. (5-21) 
This proves Lemma l5.2[ 

□ 
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It remains to prove inequality (j5.17p . This result was proved by Tao and Vu in [15] 
(see inequality (8.4) in [E]). It represents the crucial result in their proof of the circular 
law assuming a second moment only. For completeness we repeat this proof here. We 
start from the following 

Proposition 5.1. Let 1 < d < n — with ^ < 7 < 1. and < c < 1, and H 6e a 

(deterministic) d- dimensional subspace of C^. Let X be a row of An := X + M„. Then 

Pr{dist(X,]H) < cVn - d} = 0(exp{-ni}), (5.22) 
where dist(X, H) denotes the Euclidean distance between a vector X and a subspace H in 

Proof. It was proved by Tao and Vu in [15] (see Proposition 5.1). Here we sketch their 
proof. As shown in [15] we may reduce the problem to the case that E X = 0. For this it 
is enough to consider vectors X' and v such that X = X' + v and E X' = 0. Instead of 
the subspace H we may consider subspace M' = span(]HI, v) and note that 

dist{X, M) > dist(X', M'). (5.23) 

The claim follows now from a corresponding result for random vectors with mean zero. In 

what follows we assume that EX = 0. We reduce the problem to vectors with bounded 

1—7 

coordinates. Let = I{\Xj\ > n^~}, where Xj denotes the j-th coordinate of a vector 
X. Note that p„ := < n~^^~'^\ Applying Chebyshev's inequality, we get, for any 
h>0 

n 

Pr{^ > 2ni'} < exp{-/in^} exp{np„(e^ - 1 - h)}. (5.24) 
i=i 

Choosing h = j, we obtain 

Pr{j;Ci > 2nT} < exp{-— }. (5.25) 

Let J C {1, . . . ,n} and Ej := {Ylj^j{l - Cj) Hj^j^j = !}• Inequality (|5.25p implies 

Pr{ U i?j}>l-exp{-— }. (5.26) 

J:| J|>n-2nT 

Let J with |J| > n — 2n'^ be fixed. Without loss of generality we may assume that 
J = 1, . . . , n' with some n — 2n'^ < n' < n. It is now suffices to prove that 



Pr{dist(X, M) < cV^^^\Ej} = 0(exp{-— }). (5.27) 

8 

Let vr denote the orthogonal projection vr : C"" — )• C" . We note that 

dist(X,]H) > dist(^(X),7r(]H)). (5.28) 
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Let X be a random variable x conditioned on the event |x| < v} and let X = 
(xi, . . . , Xn). The relation (|5.27p will follow now from 

Pr{dist(X',E[0 < cyf^r^\\xj\ < n^~^,j ^ J} = 0(exp{- — }), (5.29) 

8 

where M' = tt{M) and X' = tt{X). We may represent the vector Xas X = X' + v, where 
u = E X and E X' = 0. We reduce the claim to the bound 



Pr{dist(X',]H") < cV^^^\\xj\ < n^~^,j ^ J} = 0(exp{-^}), (5.30) 

8 

where M" = span(?;, H'). In the what follows we shall omit the symbol ' in the notations. 
To prove (|5.30p we shall apply the following result of Maurey. Let X denote a normed 
space and / denote a convex function on X. Define the functional Q as follows 

Q/(x):=inf[/(y) + ^^]. (5.31) 
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Definition 5.2. We say that a measure satisfies the convex property (r) if for any 
convex function / on X 

/ ex-p{Qf}dfi / exp{-/}d^ < 1. (5.32) 

We reformulate the following result of Maurey (see jl3| , Theorem 3) 

Theorem 5.3. Let (Xj) be a family of normed spaces; for each i, let fii be a probability 
measure with diameter < 1 on Xj, for x G Xj. If fj, is the product of a family (/ij), then fi 
satisfies the convex property (r) . 

As corollary of Theorem 15.31 we get 

Corollary 5.3. Let in be a probability measure with diameter < 1 on X, i = 1, . . . , n. Let 

g denote a convex 1-Lipshitz function on X". Let M{g) denote a median of g. If is the 
product of the family (fii), then 

fi{\g-M{g)\>h}<4exp{-—}. (5.33) 
Applying Corollary 15.31 to /ij , being the distribution of Xj , we get 

Pr ||dist(X,]H) - M(dist(X,]H))| > rnVj < 4exp{-rVl6}. (5.34) 
The last inequality implies that there exists a constant C > such that 

|Edist(X,EI) - M(dist(X,EI))| < CnV, (5.35) 

and 

E dist(X, M) > a/e (dist(X,]H))2 - Cn^ . (5.36) 
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By Lemma 5.3 in |15] 

E(dist(X,M))2 = (1 -o(l))(n-d). (5.37) 

Since n — d > ii? the inequalities (j5.35p . (|5.36p and (j5.37p together imply (|5.22p . Thus 
Proposition 15.11 is proved. □ 

Now we prove (j5.17p . We repeat the proof of Tao and Vu [15], inequality (8.4). Fix j. 
Let A„, = X^*") — 2:M„ and let denote a matrix formed by the first n — k rows of A„ 
with k = j/2. Let a'l, 1 < I < n — k, be singular values of A^ (in decreasing order). By 
the interlacing property and re-normalizing we get 

> (5.38) 



/n 

By Lemma A. 4 in [15 



Note that 



T:=a[ V--- + a;„fc ^ = dist^2^--- + dist-!fc. (5.39) 

T>{j-k)a'-l^ = ^-a'-lj. (5.40) 
Applying Proposition 15.11 we get that with probabiHty 1 — exp{— n'^} 

71 

T<-. (5.41) 
j 

Combining the last inequalities, we get (j5.17p . 

Lemma 5.4. Under the conditions of Theorem \l.l\ there exists a constant C such that for 

1 

any k < n{l - CA^^^z)), 

Pr{sfc < An{z)} < CA^ {z). (5.42) 

Proof. Recall that Fn{x,z) = EJ>i(x,z) denotes the mean of the spectral distribution 
function Tn{x,z) of the matrix H(2;) and that F{x,z) = liuin^oo Fn{x , z) . According 
to Theorem 13. H the Stieltjes transform of the distribution function Fn{x,z) satisfies the 
system of algebraic equations ()3.2p and 

A„(z) = sup |F„(x, z) — F(x, z)| — as n — oo. (5.43) 

X 

We may write, for any k = 1, . . . ,n, 

Pr{sfc < A„(z)} < Pr{J-„(sfc, z) < J-„(A„(z)} < Pr{^^ < j:„(A„(z)}. (5.44) 

n 

Applying Chebyshev's inequality, we obtain 

Pr{., < A„(z)} < a^I^iM^ < n(F(A„(.),.)+A.(.)_ 

n — k n — k 
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It is straightforward to check that from the system of equations ()3.2p it follows 

F(A„(z),z) <CA^(z). (5.46) 
The last inequality concludes the proof of Lemma 15. 4[ 

□ 

Lemma 5.5. Let An{z) := sup^, |F„(x, z) — F{x,z)\. Then there exists some absolute 
positive constant R such that 

Pr{|Afc, \>R}< CVA„(z), (5.47) 

1 

where ki := [A^(z)n]. 

Proof. It is straightforward to check from (jS.Sip that the distribution F(x,z) is com- 

1 

pactly supported. Fix R such that F{R,z) = 1. Let us introduce kQ := [A^n]. Using 
Chebyshev's inequality we obtain, for R > 0, 

PrK„>i?}< ^~ff"^^^ <Ai 
ko/n 

On the other hand, 

fcl ki ^ ki 

Pr{|AfcJ >i2}<Pr{TT|A^| > ii'^i} < PrjTT > ij'^^} < Pr{— V ln4™) >lnR}. 

u=l u=l ^ u=l 

Let k2 = max{l < j < ko : aj > A^^(z)}. If ai < A^^(z) then k2 = 0. Furthermore, for 
any value i?i > 1, splitting into the events Sk^ > R and Sk^ < R, we get 



^ fei 

Pr{— J^lns, > lni?i} < Pr{sfc„ > R} 

+ Pr{-^ J2 lnSj+lnR>^lnRi} + Fi{^f2^nSj>^lnRi} 



u=l 

ko -, , fc2 



ki ^ ' 2 ' 'ki^ ' 2 

j=k2+l j=l 

(5.48) 

Applying Chebyshev's inequality, we get 

fci 

ki 



Pr{- J];ins, > lni?i} < Pr{sfc„ > R} 



+ Pr{^lnA;i(z)>iln|i} + f / \nxdF.^{x, z). 
h 2 R^ ki Ja-\z) 
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Now choose Ri := 2R^. Thus, since ki/ko ~ An{z), and A^(2:)| In A„(2;)| — >• 0, we get for 
sufficiently large n 

Pr{|AfcJ >R}<A^ + — / Inxd Fn{x,z). 
Taking into account that the function decreases in the interval [6~^{z), oc), we get 

■ / ]r\ xrl. F„(x.7.) < 

h Ja-\z) 

(5.49) 

Thus the Lemma is proved. □ 



/ Inxd Fn{x,z) < In A~Hz) x^d Fn{x,z) < Al{z)\nA-\z). 

Ja-^(z) m Jo 



6 Proof of the Main Theorem 

In this Section we give the proof of Theorem 11.11 For any 2; G C and an absolute constant 
c > we introduce the set ^n{z) = {w G : c/n^ < s„(z), si < n, \Xki\ < R — 
An{z)}. According to Lemma 17.41 

Pr{si(X) >n}< CtT^. 

Due to Lemma |5. II with e = c, we have 

Pr{c/n^ > Sn{z)] < + Pr{s-L > n}. 



According to Lemma l5.5( we have 

Pr{|AfcJ < i?} < C\/a;. (6.1) 
Furthermore, in view of Lemma [57 



Pr{sfc < Ar,{z)} < CA;r+' (z). (6.2) 

These inequalities imply 

Pr{J7„(z)^} < CA^(z). (6.3) 

The remaining part of the proof of Theorem 11.11 is similar to the proof of Theorem 1.1 
in the paper of Gotze and Tikhomirov [9]. For completeness we shall repeat it here. Let 
r = r(n) be such that r(n) — )• as n — )■ 00. A more specific choice will be made later. 

(r) 

Consider the potential U/^J . We have 

Uj,'] = -^E log I det(W -zl- rei)| 

= E E log |Af ) - re - - ^ E E log |Af ) - re - z\I^,^^^ 
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where Ia denotes an indicator function of an event A and i^ni^)^ denotes the complement 
of i^niz). 

Lemma 6.1. Assuming the conditions of Theorem \5.1\ for r such that 

1 

ln(l/r) (A*(^)) oo as n 



we have 



-^0, as n oo. 



Proof. By definition, we have 

1 

Applying Cauchy's inequality, we get, for any r > 0, 



(6.4) 



(6.5) 



1 



1 



1 



<(^5:E|log|Af)-re 



|l+r 



Pr{OW} 



(6.6) 



Furthermore, since ^ is uniformly distributed in the unit disc and independent of Aj, we 
may write 



E 



log \Xj — r^^ — z\ 



l+r 1 



-E 



ICI<i 



logjA^."^-* -rC,- z\ 



l+r 



dC = E J^Ve J^-'Ve J;^^^ 



(i) 



where 



r(i) _ 


1 


1 — 


2^ 


rO') _ 


1 


2 — 


2^ 


r(i) _ 


1 


3 ~ 


2^ 



|C|<1, |A('")-rC-2|<e 



loglAj™') -rC-2||^+"dC, 



ICI<1, i>|A(.™'-rC-^|>e 



loglAj'") -rC-zll^+'dC, 



loglA^.""^ -rC-^||'+"dC- 



l+r. 



ICI<1, lAt-'-r-C-.^i 



Note that 



IJ^^'^I < log 



Since for any 6 > 0, the function —vf'Xogu is not decreasing on the interval [0, exp{ — -^j], 
we have for < li < e < exp{— -^j, 



— log u < e^u ^ loe 
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Using this inequality, we obtain, for 6(1 + r) < 2, 
IjPI < flog f i)y^' [ ^ ^ |a(.-) - rC - z\-'('+^Uc (6.7) 



< ^^'^'"-^^-"'log (^) /^kJ^I"'^'^'^'^^ ^ C(r,6)eV-2 (log Q)) \ (6.8) 
If we choose e = r, then we get 



\4'\ <C{T,b) [log ^^jj . (6.9) 

The following bound holds for ^Yl]=i^ ■ ^o^^ ^^^^ |logx|^+^ < e^l log ej^+^x^ for 
X > ^ and sufficiently small e. Using this inequality, we obtain 

- y E jj^') < C{T)e^\ loge|i+n- y E IaS") - < - < C7(t)(1 + + r^)^^! loge|i+- 



1 + T 



n — ' n 



< C(r)(2 + |z|2)r2|logr|^+^|. 

(6.10) 



The inequalities ()6.7p - ()6.10p together imply that 



^^ElloglAj."") -rC-z||^+"| < C (^log(^i^^ . (6.11) 



Furthermore, the inequalities (j6.3p . (|6.5p . ()6.6p . and (j6.1ip together imply 

|C/«|<Clog fi") ((A|(.))ii^. 



We choose r = 1 and rewrite the last inequality as follows 

|f/W|<Clog(i)A|(z) (6.12) 
1 

If we choose r = A„(z) we obtain log(l/r)A^ (2:) — )■ 0, then ()6.4p holds and the Lemma is 
proved. □ 

{^\ 

We shall investigate ?7^^ now. Let f„(--- ^z^r) = E^t'„(-, z + r^) and v{-,z,r) = 
E i^(-, z + rC). We may write 

= -- E E log I Af - z - r^|/^„(,) = -- E E log(^, (X(^)(z, r))/^ 

fKn + \^\ 



logxdEF„(x,z,r), (6.13) 
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where Fn{-,z,r) {F{x,z,r) ) is the distribution function corresponding to the restriction 
of the measure Vn{--,z.,r) (z^(-,z,r)) to the set f^n(-z)- Introduce the notation 

rn+\z\ 

U^ = - log xdF{x,z,r). (6.14) 

Integrating by parts, we get 
^(0 _jj BFUx,z,r)-Fix,z,r) 

+ Csup|EF,(x,z,r) -F(x,z,r)||log(A„(z))| +E i i ^ In i . 

^ I, j=k2 ) 

(6.15) 

This implies that 

\ut! - < C\ log(A„(z))| sup |EF„(x, z, r) - F{x, z)\. (6.16) 

X 

Note that, for any r > 0, \sj{z) — Sj{z,r)\ < r. This imphes that 

EF„(x-r,z) <EF„(x,z,r) <EF„(x + r,z). (6.17) 

Hence, we get 

sup |E_F„(x, z, r) — F{x, z)\ < sup |E J"„(x, z) — F{x, 2;)|+sup \ F{x+r, z)-F{x, z)\. (6.18) 

X XX 

Since the distribution function F{x, z) has a density p{x, z) which is bounded for |z| > 

m— 1 

and p(x,0) = 0(x »"+i) (see Remark l2.7p we obtain 

sup I E (^X, Z,T ) -F{x,z)\ < sup\BTi^\x,z) -F{x,z)\ +Cr^. (6.19) 

X X 

Choose r = A„(z). InequaHties (|6.19p and (|6.18p together imply 

2 

sup\E Fn{x,z,r) - Fix, z)\ <CA™+^(z). (6.20) 

X 

From inequahties (j6.20p and (j6.16p and lemma [5^2] it follows that 



Note that 



\U^;!-U^\<CAr'{z)\lnAn{z) 



\U^/^! -U^\<\ r^^'^og xdF{x,z)\ < CA/+^(z)|ln(A„(z))|. 
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Let fC = {z £ C : \z\ < R} and let /C^ denote C \ /C. According to Lemma [53| we 
have, for ki and R from Lemma 15.51 



l-qn :=E^M(/C^) < :^ + Pr{|AfcJ >R}<C6l{z). (6.21) 

(^\ ^(r) 

Furthermore, let and fin be probability measures supported on the compact set K 
and K^'^^ respectively, such that 

E/.M = rf + (l-rfM. (6.22) 
Introduce the logarithmic potential of the measure /in , 

u^ir) = - 1 iog\z-c\dji^:\c). 

Similar to the proof of Lemma 16.11 we show that 

|C/£)-^-w|<CA|(z)|lnA„(z)|. 

This implies that 

lim U {r){z) = Uf,{z) 

for all z £ C According to equality (jl.l|) . Ufj,{z) is equal to the potential of the m-th power 
of the uniform distribution on the unit disc. This implies that the measure /i coincides 
with the m-th power of uniform distribution on the unit disc. Since the measures /Xn are 
compactly supported, Theorem 6.9 from [16| and Corollary 2.2 from |16] together imply 
that 

lim 7l([) = n (6.23) 

n— >-oo 

in the weak topology. Inequality (|6.2ip and relations (j6.22p and (j6.22p together imply that 

lim E iil^^ = 

n— >-oo 

in the weak topology. Finally, by Lemma 1.1 in [9], we get 

lim E = /X (6.24) 

in the weak topology. Thus Theorem 1 1.1 1 is proved. 

7 Appendix 

Define V,,^ ■=ULa^^''^- 

Lemma 7.1. Under the conditions of Theorem we have, for any j = 1, . . . ,n, k = 
1, . . . , n and for any 1 < a < /3 < m, 

E [Ya,^]jk = 
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Proof. For q = /3 the claim is easy. Let a < (3 and 1 < j < n, 1 < A; < n. Direct 
calculations show that 



^ ii=ii2=i i,3-c,=i 
Thus the Lemma is proved. 

In all Lemmas below we shall assume that 



EX^'f} =0, E = 1, < cTnV^ a. s. 



□ 



(7.1) 



with Tn = o(l) such that T„ '^Ln^Tn) < T^. 



Lemma 7.2. Assuming the conditions of Theorem \1.1\ as well as JY. i[ ), we have, for any 
I < a < /3 < m, 

E||V„,^||2 <Cn (7.2) 

Proof. We shall consider the case a < (3 only. Other case is easy. Direct calculations show 
that 



EIIV, 



a,l3\\2 



< 



c 



n n n P/3- 



i = lil=li2 = l i,3_a = l fc=l 

By independence of random variables, we get 

E||V,,;3||2 < Cn 

Thus the Lemma is proved. 



□ 



Lemma 7.3. Assuming the conditions of Theorem li.il as well as (7.1) we have, for any 
j = I, . . . n, k = 1, . . . ,n and r > 1, 



anc 



E ||Va^befc||2'' < Cr 



E ||eTVa^b||2'^ < Cr 



(7.3) 
(7.4) 



with some positive constant Cr depending on r. 

Proof. By definition of the matrices Va,b, we may write 



1 " 
-a+1 ^ 



1=1 



EST y('^> 

ja = l jb-l=l 



(7.5) 
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Using this representation, we get 



n n r I n n n n 



E||v„.e.iir = ;^E-EEn E^^^ E E- E ^Lu. ;., 

«1=1 1^ = 1 q=l \ja = l i6_l=lj^ = l jt-l = l 

(7.6) 

where 

ija,--.,jb3l,--;jb) jja jo.ja+1 jaja + 1 jb-2'jb~l jb-2jb-\ 3b-llq jb-llq' 

By X we denote the complex conjugate of the number x. Expanding the product on the 
r.h.s of (|7.6p . we get 

Eiiv„,.e,iir=E"Eri^j;:^;, m 

9=1 

where is taken over all set of indices ji^^ , • • • , J^l\ , Iq and ji^^ , • • • , i^i^ where j^^ , j^'^'' = 
1, . . . , Pfc, A; = a, . . . ,b— 1, = 1, . . . , and q = 1, . . . ,r. Note that the summands in the 
right hand side of (17. 7p is equal if there is at least one term in the product 17.71 which 
appears only once. This implies that the summands in the right hand side of (j7.7p are 
not equal zero only if the union of all sets of indices in r.h.s of (17. 7p consist of at least r 
different terms and each term appears at least twice. 

Introduce the following random variables, for u = a + 1, . . . ,b — 1, 

^,•(1) ,-(1) .(O^Cl) 7M 7(1) 7(r)-^ (l) (l)---^ (r) .(r)-^7(l) ^(l) ) ' " " ^ ^(r) ^(r) , 

(7.9) 

and 

Aa) _ -^(a) ^{a) ^(a) ^(a) 

Jl i---iJl iJi i---iJl JJl + 1 JJa Ja J a + 1 

Ab) _ ^{b) y{b) -yib) -yib) 

7(1) 7(r) , ~^.(i) ,-(1) ■■■"^.('■) , ^7(1) , '■■■^7('-) , • 

lb-i'---'lb-i'lb-i'---'h-i''-<i Ib-ih h-i'-q Jb-i''? Jb-i^'-q 

Let the set of indices jji^ , ■ ■ ■ , ja^ , j^^ , • • • , jl''^ contain ta different indices, say > • • • i 
with multiplicities k^i \ . . . , respectively, /cl""* + . . . + = 2r. Note that 
min{A;^"\ . . . , fc^^"^} < 2. Otherwise, |E(^^|\^) .(r)'>(i) '>(r)l = 0- By assumption (j7.ip . we 
have 

|ECS „ I < C(r„V^)2^~2*'' (7.10) 

Ja v'lja ija v?Ja 

A similar bound we get for |E(;^^['^^j .(rj-^ci) -^(r) I- Assume that the set of indices 
{ibJ*!, • • • ^ifoJ*!, ifoJ*!, • ■ ■ ^JfeJ*!} contains different indices, say, with 
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multiplicities 

^\ . . . , ^ respectively, + . . . A- = 2r. Then 

lECS, \<C{rr.^f-'^--^ (7.11) 

Furthermore, assume that for a + 1 < u <b — 2 there are tjy different pairs of indices, say, 
(ia,ia), . . . in the set 

{ja^ , • • • , , ja^ ,---,ja\---, ji-i , • • • , ji-i , , • • • , jj,- , ^1 , ^r} with multiphcities 
k[''\...,k'l''J. Note that 

k^^^ + . . . + kl'^^ = 2r (7.12) 

and 

ECji) M (1) .{r)^(i) 7M ^(1) ^(r) < C'('^n\/^) (7.13) 

The inequalities ([7T0]) - (f7?T3]) together yield 

lEn^-;, w.) I < C(r„V^)M^-)-2(*^+-+*-). (7.14) 

It is straightforward to check that the number M{ta-, . . . ,th) of sequences of indices 

Ua ,---,Ja ,Ja ,---,Ja 1 • • • 1 1 • • • 1 , 1 • • • , 1 '1 > • • • , 'r / Wltn Iq, . . . , If, OI OU- 

ferent pairs satisfies the inequality 

AA(^a,...,^fe)<Cn*"+■■■+*^ (7.15) 

with I < ti < r, i = a, . . . ,b. Note that in the case ta = ■ ■ ■ = h = r the inequalities 
(mO]) - (rm]) imply 

Ed(l) M (1) .(r)^(l) 7(r) - ^ C^-IS) 

The inequalities ()7.15p , ()7.14p , (I7.16P , and representation (|7.6p together conclude the proof. 

□ 

The Largest Singular Value. Recall that |A^'"^| > . . . > \\^^\ denotes the eigen- 
values of the matrix W ordered by decreasing absolute values and let s^^™'' > . . . > si'"'' 
denote the singular values of the matrix W. 

We show the following 

Lemma 7.4. Under the conditions of Theorem \l.l\ we have, for sufficiently large K >\ 

Pr{sS™) > n} < C/n (7.17) 

for some positive constant C > 0. 
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Proof. Using Chebyshev's inequality, we get 

Pr{sS"'^ > n} < ^ETr fwW*) < - (7.18) 

Thus the Lemma is proved. □ 
Lemma 7.5. Under conditions of Theorem \1.1\ assuming (7.1), we have 

E -(TrR- ETrR) < — ^. 

n nv^ 

Proof. Consider the matrix X^^'-'^ obtained from the matrix X^^^ by replacing its j-th row 
by a row with zero-entries. We define the following matrices 

H(-.i)=HM_e^.ejH('^), 

and 

^{m-v+i,j) ^ ^{va-v+i) _ H("-''+i)ej-+„eJ+„. 
For the simplicity we shall assume that u < m — u + \. Define 

v—l m—u m 

q=l q=v+l q=m—u+2 

Let \{v,j){z) = V(z^, j)J — J(z). We shall use the following inequality. For any Hermitian 
matrices A and B with spectral distribution function Fa{x) and Fb{x) respectively, we 
have 

|Tr(A - al)-i - TV(B - aI)-'\ < '^"''^'^ ~ (7.19) 

V 

where a = u + iv. It is straightforward to show that 

rank(V(z) - V^'''^\z)) = rank(VJ - V^'^'-'^J) < 4m. (7.20) 
Inequality ()7.19p and (|7.20p together imply 

I — (TVR-TrR('^'^'))| < — . 

After this remark we may apply a standard martingale expansion procedure. We 
introduce cr-algebras J^j = ^{^ik\ j < I < n,k = 1, . . . ,n; , q = u + 1, . . . m, p = 
1, . . . , n, fc = 1, . . . , n} and use the representation 

m n 

TrR- ETrR = ^ ^(E j.j_iTrR - E ^jTrR), 

u=l j=l 

where Eu,j denotes conditional expectation given the ci-algebra J^uj- Note that = 
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Lemma 7.6. Under the conditions of Theorem li.il we have, for I < a,< m, 

1 ^ n ^ 

n — ' — ' n?;^ 
k=i j=i 

and, for 1 < a, < m — 1, 

n n 
E | — (y^[Vm-a+2,mJRVl,-m-a+l]fc,fc — E [Vm-a+2,??t JRVl,m-a+l]fcfc) | ^ < - 



fc=l i=l 

Proof. We prove the first inequality only. The proof of the other one is similar. For 



= 1, . . . , m and for j = 1, . . . , n, we introduce the matrices, X^'"'-'-' = X^^^^ — ejejx^*^) 
and H(^'-') = H^"^) - ejeJU^"^ and 
^(m~u+i,j) ^ jj^im~u+i,j) _ H(™-'^+i)ej+„eJ_^_„. Note that the matrix X^'^'^) is obtained 
from the matrix X^''^ by replacing its j-th row by a row of zeros. Similar to the proof 
of the previous Lemma we introduce the matrices V^'^^'''' by replacing in the definition of 
Vc,d the matrix U'^"^ by H^'^'J) and the matrix h("'^''+i) by h(™-^+1j). For instance, if 
c < u < m — v + 1 < d we get 

m—v b 
q=a q=u-\-\ q=m—v+l 

Let V^'^'J') := Vj'';^^ and R(^) := (V^^'^Xz) - al)-^ . Introduce the following quantities, 
for V = \ . . . ,m and j = 1, . . . , n, 



n n 
k=l k=l 



We represent them in the following form 



^ ._ ^(1) , ^(2) , ^(3) 

"J . -r -r "J , 



where 



"^^] y^[(Va+l,m - V^'^-\-'_^)JRVi,m,-a+lJfc,fc+n, 

n 

fc=l 
k=l 
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Note that 

By definition of tlie matrices Jl'^'^ and H™^'^"'"^'-'' , we liave 

n 

,m—u+l]k,k+n ,m— a+1 

k=l 

,m—a+l'f'^ a+l,m—a+l\j+n,j+n^ 

where 

" Vo o 

This equality implies that 

+ |[Vm-i/+2,m.JKVi 

,m— a+lJ"^a+l,m— i/+l]j+nj+n| ■ 

Using the obvious inequality Yl]=i^'jj — ll-^lll niatrix A = (ojfc), j,k 

1, . . . , n, we get 



,m— a+l 



+ E ||Vm-!/+2,mJR-Vi^m-a+lJVa+i^m-r/+l||2- 



By Lemma 17.21 we get 



C Cn 
Ti < ^E ||Va+i m_a+i||2 < (7-21) 

V V 



Consider now the term 



n 



Using that R - R(j) = -R(j)(V(z) - V('''J)(z))R, we get 

n 

|Hf I < I ^[vi'^)jRVi,,„ie,-eJV,,™RVi,6]fc,fc+„| 
fc=i 

< [JH*-"^"^''Vc+2,m-aH'''" ""'"^'■^'''Vm_Q+2,m.KVi^m_.Q,V^^j^^^JRVi^c,]jj. 

This implies that 

t(2) < CE||[V,+i,^JRVi,bVa,™JRyi,,||i. 
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It is straightforward to check that 



r(2) < E ||Vi,„JH("+i) V,+2,m-aH("^-°+i'^')v„_„+2,m||i = E IIQIli 



(7.22) 



The matrix on the right hand side of equation (17.22^ may be represented in the foUowing 
form 



This imphes that 
Similar we prove that 



where = or = 1 or = 2. Since xis^ = 0, for x = 1 or x = 2, we have 

eihh:,p<^. 

n 

T2 < Cn. 

Inequahties (fTnl) . (f7:23]l and (f7:2i]l together imply 

n 

^E|S,f <C7n 
i=i 

Applying now a martingale expansion with respect to the cr-algebras Tj generated by the 
random variables X^^^^ with l<A;<j, l</<n and all other random variables 
except g = a + 1 , we get 



(7.23) 
(7.24) 



-j^ n n 

,m—a\kk+n ,m—a\kk+n)\ _ 



k=l 



c 



Thus the Lemma is proved. 



□ 



Lemma 7.7. Under the conditions of Theorem \l.l\ we have, for a = 1, . . . , m, there exists 
a constant C such that 



3 

77-2 



i=i k=i 



,m— Q+l j //i(cf) vi^)\ 



dX) 



{ay 



jk jk 



jk 



kj 



< CTnV~ 



35 



and 

1 

f 
ri2 



E 



Pm — a Pin — Q.-\-l 

E E 

j=i k=i 



{m—a+l) T^(m.-o+l) 



52(V,+i,„JRVi 



{0 



jk 



jk 



j+n,k 



< CTnV-\ (7.25) 



where and are independent in aggregate for a = l,...,m and j = l,...,n, 

k = I, . . . ,n, and are r.v. which are uniformly distributed on the unit interval. 

By — A{6j'^^ Xj'^^ ) we denote the matrix obtained from — ^^^A by replacing its entries 

hyef^x%\ 

Proof. The proof of this lemma is rather technical. But we shall include it for completeness. 
By the formula for the derivatives of a resolvent matrix, we have 

<9( Va+l^m JRVl,m-a+l ) 



dX 



(a) 



jk 



1=1 



(7.26) 



Ql ——i=^a+l,m'^^^l,a~l^j^k'^oi+l,m~a+lI{a<m-a+l}) 
1 



Q2 
Q3 
Q4 



Vq+i,,„JRVi 

,m~a^k+n^j- 



1 



_ rp 



n 



1 



T 



Qs — , — ^a+l,m—a^k+prn-a^j+n^rn—a+2,rnJ^!^^l,m—a+lI{a<m—a+l})- 

Introduce the notations 



+l,m 



= V 



l,m— o+l ■ 



Prom formula (j7.26p it follows that 

52(UaJRV„) 



dX, 



dQi 

1=1 ox-^ 



E 



^jk '=J^ J* 

Since all the calculations will be similar we consider the case / = 3 only. Simple calculations 
of derivatives show that 



O^jk m=l 



(7.27) 
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where 



p(i 

p(2 
p(3 
p(4 
p{5 
p{6 
p{7 



\ rp rp 

1 T T 



n 

1 

n 
1 

n 



T T 

Uq JRVm_Q+2eje;, Vq,+i JRVc 



U A. J RVm _ 4- e 1 e I, U„JRV r. 



— UaJRVQ+iefc+„ej^„Um-o+i JRVm-a+2eje|'UQ,JRVo 
— UQ,JRVm-a+2eje;, UQjRVQ,+iefc+„ej_,_„Um-Q+i JRVo 

— UciJRVm-a+2eje^UQ,JRVm-a+2eje^UaJRVa. 



Consider now the quantity, for [i= 1, . . . , 5, 



n2 



(7.28) 



i=i fc=i 

We bound L3 only. The others terms are bounded in a similar way. First we note that 

T) n 

^3. 



EEe4^ ^^^^^^ = 0' for = 1,2,3. 

i=i fe=i 



(7.29) 



Furthermore, 



E |x]j'||[p(4)]fc,| < E |x]^)|3|[U,JRV^_«+2]fe,f |[UaJRV«]fc,-|. (7.30) 



Let Uo'^^ ( Vq''^^) denote matrix obtained from Uq (Vq,) by replacing X"^^ by zero. 
We may write 



m— Q+2,m- 



(7.31) 



and 



Using these representations and taking in account that 



(7.32) 



37 



we get by differentiation 

B\X^f\\[P'^%j\ < iE|4'^)'||[U,JRV^„«+2]fe,f |[U(^''^)jRVp)]fc,|. (7.33) 



n 



Furthermore, 



a\\2 



|[UaJRVm-a+2]fcj| < - || Vm-a+2ej ||2 ||efc U, 

|[u2»JRV(^-''=)]fc,| < i||v(f»e,||2||ejui^»||2. 



(7.34) 



Applying inequalities (j7.33p and (|7.34p and taking in account the independence of entries, 
we get 



(7.35) 

Applying Lemma 17.31 we get 



j=i k=i 

The assumption (|7.ip now yields 



^ n n „ n n 



(")|3 
jk I 



(7.36) 



j=i k=i 



^ n n 

n2 - I ,_i 



(7.37) 



j=i k=i 

Similar we get corresponding bounds for = 5, 6, 7 



n n 

^EEE|^]?n[P^%-|<t^Tn. 
j=l k=l 



and 



I-Z^mI ^ C*"^"' M = 1, • • • ,5. 



The bound of the quantity 



j=i fc=i 

is similar. Thus, the Lemma is proved. 



dX 



{a) 
jk 



kj 



(7.38) 



(7.39) 



(7.40) 



□ 
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Lemma 7.8. Under the conditions of Theorem \l.l\ we have 



^ ^ E x^i^ [Vj,+i,mJRVi,m-i/+i]fci - y^y^E 

j=l k=l j=l k=l 



9V,+i,^JRVi 



dX 



jk 



kj 



and 



,m—u+l]j+n,k 

j=l k=l 



j=l k=l 



av,+i,„jRVi 



dX 



jk 



+ en{z,a)), 



j+n,k 



where |e„(z,a))| < 

Proof. By Taylor expansion we have, 

Ee/(e) = /'(o)E^2 + E (1 - e)ef"{0O, 

and 

/'(0)=E/'(e)-Eem) 



(7.41) 



where 9 denotes a r.v. which uniformly distributed on the unit interval and is independent 
on ^. After simple calculations we get 



j=l k=l j=l k=l 

n n 

i=l k=l 



9V,+i,„JRVi 



dX 



jk 



kj 



^ik ) 



dX 



jk jk 



jk 



Using the results of Lemma 17.71 we conclude the proof. 



kj 



□ 
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